Pivotal Data Dispatch

Improve your Big Data Productivity

Now is the time to take advantage of the massive amounts of data your customers, partners, employees and infrastructure are generating. Whether you have a team of data scientists or just a few analysts, Pivotal Data Dispatch gives your data experts on-demand access to big data from internal and external sources. With higher data worker productivity, your enterprise can improve real-time decision making.

Your analysts can discover data across disparate internal and external sources through a web portal, and create analytical sandboxes on Hadoop or massively parallel processing (MPP) systems. Because IT administrators establish data models and access policies, enterprises using Pivotal Data Dispatch improve security and compliance while maintaining control.

With Pivotal Data Dispatch, you can deliver faster analytics by enabling self-service discovery and access to data. IT can keep control over access control, policy enforcement and auditing. And you can increase efficiency by automating daily provisioning requests and managing data growth through leased sandbox creation.

Best of all, our solution is proven. Since 2007, the NYSE has been using Pivotal Data Dispatch to provision millions of files and terabytes of data per day, in near real-time.

View the Pivotal Data Dispatch NYSE Euronext Case Study.

PIVOTAL Data Dispatch Features

Increase Your Data Analysis ROI

With Pivotal Data Dispatch, your enterprise can improve real-time decision making and data worker productivity. The solution delivers capabilities in three key areas:

  • Discovery - With Pivotal Data Dispatch, your data workers simply log in to a web portal to browse through data from across internal and external sources. Without worrying about file locations or formats, they can view all of the data that IT administrators have given them permission to view. Moreover, they can view that data in business, rather than technical, terms to improve associations. All of their searches, as well as administrator actions and resource usage are captured in a metadata catalog.
  • Self-Service - Your analytic teams can use Pivotal Data Dispatch to provision terabytes and petabytes of data from multiple sources onto sandboxes in Hadoop or MPP systems, on demand. The system gathers requested data from all sources, translates it, applies the right IT-defined policies, and loads the data onto an analytical platform, such as Pivotal Hadoop or Pivotal HAWQ. Using the integrated workflow tool, your analysts can design complex analytical workflows that include data movement from heterogeneous sources.
  • Control - Pivotal Data Dispatch includes an IT rules framework for access and rights management so that you can be sure analysts can access only the information that you want them to discover. The solution helps you achieve greater security and compliance because your IT administrators automate role-based access and compliance enforcement through Pivotal Data Dispatch. A single metadata catalog stores all metadata, maintains data lineage, and logs user actions for easy auditing. We also enable sandboxes with an associated lease and data is cleaned up after analyses to help you reduce the waste of expensive MPP resources and the risk of data leaks.

PIVOTAL Data Dispatch Technology

How Does Pivotal Data Dispatch Work?

The leading on-demand, big-data platform, Pivotal Data Dispatch can provide your analytics team with access to data across internal and external data sources while supporting existing visualization and analytical tools. You can provision terabytes and petabytes of data from multiple sources onto sandboxes in Hadoop or MPP systems in near real time.

Highly scalable to meet discovery demands, Pivotal Data Dispatch is installed as a middleware service on a commodity Linux cluster. It includes native, high-speed adapters and resource monitoring for multiple platforms, including Pivotal HD and HAWQ, Pivotal Greenplum Database (GPDB), Apache Hadoop, IBM Netezza, Oracle and SQL Server, PostgreSQL, HyperSQL DataBase (HSQLDB), and Composite. Pivotal Data Dispatch can also connect to any database using JDBC, and with common distributed file systems such as Network File System (NFS).

PIVOTAL Data Dispatch Technology

What is the Single Metadata Catalog?

Using Pivotal Data Dispatch, your IT administrator can present technical expressions and relationships in easily understood business terms. These business-abstracted views and schema for all data are then stored in a single metadata catalog, where information is mapped between sources and destinations. Transformation workflows can also be cataloged for future use.

The metadata catalog stores every analyst search and administrator action, as well as resource usage in an ANSI SQL database. The catalog also maintains data lineage, simplifying audits. However, before users, administrators and auditors begin to search all accessible data, administrators can leverage the catalog for unified access control across data platforms to ensure only those with permission can access certain sources.

PIVOTAL Data Dispatch Technology

How Is the Workflow Tool Used?

Your analysts can use the workflow tool in Pivotal Data Dispatch to design complex analytical workflows that include data movement from heterogeneous sources. IT can also standardize analytics reporting by building standard workflows that are shared across the company through the catalog.

The workflow tool also supports the creation of workflows for data cleansing, reformatting and augmentation activities—ranging form very simple to complex transformations—that save time and improve results. Data gathering, consolidation and integration can be improved by using the workflow tool to map relationships prior to analysts accessing new internal or external sources. With Pivotal Data Dispatch’s workflow tool, your organization can also generate a user data mart.

PIVOTAL Data Dispatch Technology

What is the Resource Manager?

The resource manager in Pivotal Data Dispatch enables your IT administrator to set policies that manage load balances across analytical platforms. This level of granular control allows IT teams to establish different service-level agreements (SLAs) for different groups within your organization.

Through a single interface, resource manager also gives your IT team visibility into the real-time use of your analytical platforms and the status of every job. That way, if needed, your IT team can manage individual user jobs.

PIVOTAL Data Dispatch Technology

How Is Search Used in Pivotal Data Dispatch?

Data analytics teams use Pivotal Data Dispatch search to discover data across disparate internal and external sources through a web portal. Because IT administrators establish access policies in advance of searches, data workers can be restricted from viewing certain sources.

IT administrators use Pivotal Data Dispatch to search the metadata catalog. With the information they uncover, IT teams can better understand user activity, server usage and other metadata.

For auditors, Pivotal Data Dispatch search delivers insight into user and administrator logs contained in the metadata catalog.

RELATED RESOURCES

News and events, blog posts, videos, case studies, whitepapers, and other related resources.

SEE ALL RESOURCES

How Pivotal plans to close the big data productivity gap


Dec 29, 2013 | DatacenterDynamics

ROI CASE STUDY: Pivotal Data Dispatch NYSE Euronext


White Paper |

With Pivotal Data Dispatch, you can deliver faster analytics by enabling self-se...


Video | Oct 28, 2013

At the first-ever Pivotal Summit in Singapore, Pivotal, the company at the inter...


Oct 23, 2013 | CIOL

While EMC and VMware spinoff Pivotal prepares to launch its business intelligenc...


Oct 23, 2013 | PCWorld

While EMC and VMware spinoff Pivotal prepares to launch its business intelligenc...


Oct 23, 2013 | PC World

The leading on-demand, big-data platform, Pivotal Data Dispatch can provide your...


Datasheet |

Contact Pivotal
Pivotal Support