Data Management


Generating Sample Files for Data Preparation

Citi Bike provides data monthly as zipped comma-separated values (.csv) files that contain the following data values:

  • Trip Duration (seconds) 
  • Start Time and Date
  • Stop Time and Date
  • Start Station Name
  • End Station Name
  • Station ID
  • Station Latitude/Longitude
  • Bike ID
  • User Type (Customer = 24-hour pass or 3-day pass user. Subscriber = Annual Member.)
  • Gender (Zero=unknown; 1=male; 2=female)
  • Year of Birth 

To download a ridership file;

Preparing Data With a Data Flow

Before you load data into your target data source, you can enhance it for your needs. This massaging of the data prior to loading is called data preparation. You can take advantage of the data preparation options to, for example, convert numeric codes to meaningful attributes, discard erroneous data, smooth out ragged data into manageable bins, and blend descriptive data from additional data sources. 

Video: New Data Preparation Workflow

Before you load data into your target data source, you can enhance it for your needs in a process called data preparation, which features options allowing you to convert numeric codes into meaningful attributes, discard erroneous data, smooth ragged data out into manageable bins, and blend descriptive data from additional sources. You can also use data preparation calculations to create new fields.

You can access data preparation options when you create a new data flow from the Applications page by clicking New and selecting Flow.

Generating WebFOCUS Retail Demo Sample Data

You can generate WebFOCUS Retail Demo sample data and metadata using the WebFOCUS Server or DataMigrator Server, and use it to test WebFOCUS features with a consistent, preconfigured data source. This sample data set is also used in many examples in technical topics and videos, allowing you to follow along to get the same results.

You can generate these sample files using the following steps.

Adding a Custom Geographic Role

The GEO configuration editor in the WebFOCUS Server provides a tool for editing or adding properties for geographic roles.

On the WebFOCUS start page, from the Management Center, click Server Workspaces to access the WebFOCUS Reporting Server Workspace area. Alternatively, from the WebFOCUS Home Page, click the Settings menu and click WebFOCUS Server. When the WebFOCUS Reporting Server browser interface opens, open the Tools menu and click Workspace. The Workspace area opens.

Generating WebFOCUS Retail Demo Sample Data

You can generate WebFOCUS Retail Demo sample data and metadata using the WebFOCUS Reporting Server or DataMigrator Server, and use it to test WebFOCUS features with a consistent, preconfigured data source. This sample data set is also used in many examples in technical topics and videos, allowing you to follow along to get the same results.

You can generate these sample files using the following steps.

Filtering Data in Profile Bar Charts

From the Web Console, when viewing data profile charts in a data flow, you can select one or more values to see how your selection affects the other fields. This allows you to preview how a filter will affect your data, before you create a filter in the data source. You can then use your selection to create a permanent filter that includes or excludes the selected fields when your data is loaded into a target.

Creating Data Flows

Data flows allow you to extract information from data sources, and load it into data targets for future analysis and use. You create data flows from the Web Console by right-clicking an application folder or synonym, and selecting the Flow shortcut menu option to open the data flow canvas.

You can build a data flow from a set of objects that identify data sources, data columns to include, and data targets. A flow is loaded to form a data warehouse, data mart, or any other type of target, containing only the data you need.

iWay DataMigrator User's Guide PDF

This content describes how to install and use iWay DataMigrator, formerly ETL Manager. It is intended for the user responsible for transforming data by designing and executing data and process flows.

Describing Data With WebFOCUS Language PDF

Describes metadata for TIBCO WebFOCUS® files.