In connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted. Data Stream is a set of extracted information from data provider. It contains raw data that was gathered out of users’ browser behavior from websites, where a dedicated pixel is placed. Data Stream is useful for data scientists for Big Data and AI algorithms supply. Main data stream providers are Data technology companies: OnAudience.com, Lotame, ShareThis, AddThis, 33 Across.
In a formal way, a data stream is any ordered pair where:
Data Stream Content
Data Stream contains different sets of data, that depend on the chosen data format.
- Attributes - each attribute of the data stream represents a certain type of data, e.g. segment / data point ID, timestamp, geodata.
- Timestamp attribute helps to identify when an event occurred.
- Subject ID is an encoded by algorithm ID, that has been extracted out of a cookie.
- Raw Data includes information straight from the data provider without being processed by an algorithm nor human.
- Processed Data is a data that has been prepared (somehow modified, validated or cleaned), to be used for future actions.
Data Stream Usage
There are various areas, where Data Stream is used:
- Fraud detection & scoring - raw data is used as source data for an anti-fraud algorithm (data analysis techniques for fraud detection). For example, timestamp or amount of cookie occurrences or analysis of data points are used within the scoring system to detect fraud or to make sure that a message receiver is not a bot (so-called Non-Human Traffic).
- Artificial Intelligence - raw data is treated like a train set and a test set during AI and machine learning algorithms building.
- Raw data is used for profiling and personalization to customize user profiles and divide them for segmentation, e.g., per gender or location (based on data point).
- Business Intelligence - raw data is a source of information for BI systems, used for enriching user profiles with detailed information about them, e.g., purchase path or geodata. This information is used for business analysis and predictive research.
- Targeting - processed data by data scientists improve online campaigns and is used for reaching the target audience.
- CRM Enrichment - raw data is integrated with Customer-relationship management system. CRM integration allows to fill the gaps in users' profiles with demographic data, interests or buying intentions.
Data Stream Integration
Core integrations with Data Stream are:
- Data Stream is integrated with systems such as Customer Data Platform (CDP), Customer Relationship Management (CRM) or Data Management Platform (DMP) to enrich users' profiles with external data. It’s possible to expand the knowledge about existing users by using external sources.
- Data Stream is used to enrich Business Intelligence systems and make analysis more precise and conclusions more accurate.
- In the case of Content Management System (CMS) integration, Data Stream is used to identifying the users and personalize their visit, even if it’s their first one. By data analysis, the actual content of the website is adapted to the user.
- Data Stream is integrated with Demand Side Platform (DSP) within programmatic advertising ecosystem. Parties (e.g., advertisers) can exchange the users' IDs and concatenate with them existing profiles.
- Data Stream is used to choose respective user segments (e.g., people interested in the automotive industry) and use them in an online campaign. Segments are enriched with more user characteristics out of data stream and then sent to DSP.
Data Sources visible on Data Stream
In Data stream it is visible what device has been used by the user side - it is visible on User Agent:
- mobile - when a user uses a mobile browser to explore, it has narrow screen resolution and mobile app version, respectively;
- desktop - when a user uses a desktop browser or app version.
The following information is shared out of used device:
- Actual URL to the visited website, where an event occurred
- User Agent
- Internet Protocol (IP)
Data Stream Formats
Data point is a tag that collects information about a certain action, performed by a user on a website. Data Point exists in two types, the values of which is used to create appropriate audiences. Those are:
- ‘event’ with information about occurrences of the specific event (e.g., click on a link or displaying ad)
- ‘attribute’ with numerical or alphanumerical values.
Segment is a logical statement, built on specific Data Points using AND, OR or NOT operators.
Hybrid data - raw data out of both Data Point and Segment data formats.
URLs - is a set of information about a particular URL that has been visited.
Data Stream and GDPR
Gathered information out of websites are based on user behavior. Data providers deliver both personal or non-personal information. There are two types of users data available in data stream:
- Personally Identifiable Information (PII) - information that allows clearly or by combining with data identification methods identify a person. Examples of PII are: insurance ID, email address, phone number, IP address, geolocation, biometric data.
- Non-personally identifiable information (non-PII) is information that can’t be used to identify a person or to track a location. A cookie or a device ID is an example of non-PII.
- Federal Standard 1037C data stream
- "Data Stream". techopedia.com.
- "Attribute". businessdictionary.com.
- "What constitutes data processing?". ec.europa.eu.
- "Non-Human Traffic [NHT]". theonlineadvertisingguide.com.
- "BEHAVIORAL PROFILING AND PERSONALIZATION: CUSTOMER EXPERIENCE FIRST". selligent.com.
- "What is Targeting - Meaning". selligent.com.
- "What is Data Stream and how to use it". OnAudience.com.
- "The 6 types of user segmentation and what they mean for your product". uxdesign.cc.
- "What is hybrid data management". ibm.com.
- "What is personally identifiable information (PII)? How to protect it under GDPR". csoonline.com.
- Ha, Anthony. "Lotame pitches an 'unstacked' approach to selling data tools". techcrunch.com.
- "Raw data (source data or atomic data)". searchdatamanagement.techtarget.com.
- Alley, Garret. "What is Data Streaming?". alooma.com.
- "What is streaming data?". quora.com.
- "HOW TO USE DATA STREAMING FOR BIG DATA". dummies.com.
- "Lotame Launches Data Stream". destinationcrm.com.
- Perera, Srinath. "A Gentle Introduction to Stream Processing". medium.com.
- "What is DATA STREAM MINING?". youtube.com.