{"id":982,"date":"2012-04-23T10:21:52","date_gmt":"2012-04-23T02:21:52","guid":{"rendered":"http:\/\/www.indataweb.com\/?p=982"},"modified":"2024-09-20T10:43:00","modified_gmt":"2024-09-20T18:43:00","slug":"data-aggregation-the-answer-to-big-data","status":"publish","type":"post","link":"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/","title":{"rendered":"Data Aggregation: The Answer to Big Data?"},"content":{"rendered":"<p>Interesting perspective in Wall Street &amp; Technology last week from a performance measurement solution vendor. The premise is that data aggregation is the answer to keeping up with the ever-increasing demands of big data. At first glance, this seems like a sound concept but upon further examination, it would not hold up for the needs of an average asset management firm.<\/p>\n<h2>Understanding the Limitations of Custodian Data<\/h2>\n<p>First, while all buy-side firms have to reconcile their books and records to their custodians, custodian downloads only contain the basics that are used for client portfolio reporting, namely positions &amp; transactions. This is good for a performance measurement-only system, since aggregating transaction downloads saves a lot of work, rather than trying to go to each custodian directly or trying to gather transaction data from in-house systems for use in dashboards and client reports.<\/p>\n<p>The problem arises in the data that is required to manage the investment process itself, namely portfolio analytics \u2013 It is not typically provided by custodians. If it is, it\u2019s only provided at a basic level and isn\u2019t useful for pre-trade investment decisions since it&#8217;s not provided until the following day, at the earliest.<\/p>\n<h2>The Challenge of Accessing Non-Custodian Data<\/h2>\n<p>And this is where the data aggregation argument falls apart. Big data and the data management process itself have a much bigger role in the aggregation of data from sources other than the custodians, namely analytics and pricing services from various vendors. The challenge becomes getting access to this data. Custodial data aggregators can\u2019t get it because the data is internal to the individual investment firm. From there, the challenge increases when trying to validate this data to make sure that it\u2019s accurate before it\u2019s used to make investment decisions or before it ends up on a client report. This is where data management technology comes into play and this technology has to come from other sources either internal or external, since the data aggregators only get data from custodians.<\/p>\n<p>So in summary, data aggregation can help with big data in certain specialized areas but it\u2019s not the be-all, end-all answer for the big data challenge. The answer is data management technology itself, whether it&#8217;s built in-house at a huge expense to the firm or provided by third-party vendors.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The premise is that data aggregation is the answer to keeping up with the ever increasing demands of big data. At first glance, this seems like a sound concept but upon further examination, it would not hold up for the needs of an average asset management firm.<\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_stc_notifier_status":"sent","_stc_notifier_sent_time":"2023-01-11 07:00:16","_stc_notifier_request":false,"_stc_notifier_prevent":false,"_stc_subscriber_keywords":"","_stc_subscriber_search_areas":"","content-type":"","footnotes":""},"categories":[177,71,100,38,41],"tags":[],"class_list":["post-982","post","type-post","status-publish","format-standard","hentry","category-ai-investment-management","category-big-data","category-blog-articles","category-data-management","category-technology"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Data Aggregation: The Answer to Big Data? | INDATA<\/title>\n<meta name=\"description\" content=\"Data aggregation is the answer to big data. Learn how to make sense of large and complex datasets to gain insights and make better decisions.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Data Aggregation: The Answer to Big Data? | INDATA\" \/>\n<meta property=\"og:description\" content=\"Data aggregation is the answer to big data. Learn how to make sense of large and complex datasets to gain insights and make better decisions.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/\" \/>\n<meta property=\"og:site_name\" content=\"INDATA\" \/>\n<meta property=\"article:published_time\" content=\"2012-04-23T02:21:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-09-20T18:43:00+00:00\" \/>\n<meta name=\"author\" content=\"David Csiki\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@indataipm\" \/>\n<meta name=\"twitter:site\" content=\"@indataipm\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"David Csiki\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/\"},\"author\":{\"name\":\"David Csiki\",\"@id\":\"https:\/\/www.indataipm.com\/#\/schema\/person\/31ac2144f306e999a05ada27d5434beb\"},\"headline\":\"Data Aggregation: The Answer to Big Data?\",\"datePublished\":\"2012-04-23T02:21:52+00:00\",\"dateModified\":\"2024-09-20T18:43:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/\"},\"wordCount\":394,\"publisher\":{\"@id\":\"https:\/\/www.indataipm.com\/#organization\"},\"articleSection\":[\"AI Investment Management\",\"Big Data\",\"Blog Articles\",\"Data Management\",\"Technology\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/\",\"url\":\"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/\",\"name\":\"Data Aggregation: The Answer to Big Data? | INDATA\",\"isPartOf\":{\"@id\":\"https:\/\/www.indataipm.com\/#website\"},\"datePublished\":\"2012-04-23T02:21:52+00:00\",\"dateModified\":\"2024-09-20T18:43:00+00:00\",\"description\":\"Data aggregation is the answer to big data. Learn how to make sense of large and complex datasets to gain insights and make better decisions.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.indataipm.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Data Aggregation: The Answer to Big Data?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.indataipm.com\/#website\",\"url\":\"https:\/\/www.indataipm.com\/\",\"name\":\"INDATA\",\"description\":\"iPM Intelligent Portfolio Management\",\"publisher\":{\"@id\":\"https:\/\/www.indataipm.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.indataipm.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.indataipm.com\/#organization\",\"name\":\"INDATA\",\"url\":\"https:\/\/www.indataipm.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.indataipm.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.indataipm.com\/wp-content\/uploads\/2022\/08\/indata-ai-logo-sml.png\",\"contentUrl\":\"https:\/\/www.indataipm.com\/wp-content\/uploads\/2022\/08\/indata-ai-logo-sml.png\",\"width\":280,\"height\":51,\"caption\":\"INDATA\"},\"image\":{\"@id\":\"https:\/\/www.indataipm.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/indataipm\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.indataipm.com\/#\/schema\/person\/31ac2144f306e999a05ada27d5434beb\",\"name\":\"David Csiki\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.indataipm.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/1257edd5d055e5cd9d3ceed07b6b48fd6a252570d3e5a987df87f403e2fb1a9e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/1257edd5d055e5cd9d3ceed07b6b48fd6a252570d3e5a987df87f403e2fb1a9e?s=96&d=mm&r=g\",\"caption\":\"David Csiki\"},\"description\":\"David Csiki is the Managing Director and President of INDATA, a leading industry provider of software and services for buy-side firms including trade order management (OMS), compliance, portfolio accounting, and front-to-back office technology solutions. Prior to joining INDATA, Csiki was Manager of Marketing and Investor Relations at NYFIX, Inc. and was instrumental in developing the product concept and planning the successful launch of the company\u2019s flagship product, NYFIX, a FIX broker network.\",\"sameAs\":[\"https:\/\/www.linkedin.com\/in\/david-csiki-0a59799\"],\"url\":\"https:\/\/www.indataipm.com\/author\/csiki\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Data Aggregation: The Answer to Big Data? | INDATA","description":"Data aggregation is the answer to big data. Learn how to make sense of large and complex datasets to gain insights and make better decisions.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/","og_locale":"en_US","og_type":"article","og_title":"Data Aggregation: The Answer to Big Data? | INDATA","og_description":"Data aggregation is the answer to big data. Learn how to make sense of large and complex datasets to gain insights and make better decisions.","og_url":"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/","og_site_name":"INDATA","article_published_time":"2012-04-23T02:21:52+00:00","article_modified_time":"2024-09-20T18:43:00+00:00","author":"David Csiki","twitter_card":"summary_large_image","twitter_creator":"@indataipm","twitter_site":"@indataipm","twitter_misc":{"Written by":"David Csiki","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/#article","isPartOf":{"@id":"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/"},"author":{"name":"David Csiki","@id":"https:\/\/www.indataipm.com\/#\/schema\/person\/31ac2144f306e999a05ada27d5434beb"},"headline":"Data Aggregation: The Answer to Big Data?","datePublished":"2012-04-23T02:21:52+00:00","dateModified":"2024-09-20T18:43:00+00:00","mainEntityOfPage":{"@id":"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/"},"wordCount":394,"publisher":{"@id":"https:\/\/www.indataipm.com\/#organization"},"articleSection":["AI Investment Management","Big Data","Blog Articles","Data Management","Technology"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/","url":"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/","name":"Data Aggregation: The Answer to Big Data? | INDATA","isPartOf":{"@id":"https:\/\/www.indataipm.com\/#website"},"datePublished":"2012-04-23T02:21:52+00:00","dateModified":"2024-09-20T18:43:00+00:00","description":"Data aggregation is the answer to big data. Learn how to make sense of large and complex datasets to gain insights and make better decisions.","breadcrumb":{"@id":"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.indataipm.com\/data-aggregation-the-answer-to-big-data\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.indataipm.com\/"},{"@type":"ListItem","position":2,"name":"Data Aggregation: The Answer to Big Data?"}]},{"@type":"WebSite","@id":"https:\/\/www.indataipm.com\/#website","url":"https:\/\/www.indataipm.com\/","name":"INDATA","description":"iPM Intelligent Portfolio Management","publisher":{"@id":"https:\/\/www.indataipm.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.indataipm.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.indataipm.com\/#organization","name":"INDATA","url":"https:\/\/www.indataipm.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.indataipm.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.indataipm.com\/wp-content\/uploads\/2022\/08\/indata-ai-logo-sml.png","contentUrl":"https:\/\/www.indataipm.com\/wp-content\/uploads\/2022\/08\/indata-ai-logo-sml.png","width":280,"height":51,"caption":"INDATA"},"image":{"@id":"https:\/\/www.indataipm.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/indataipm"]},{"@type":"Person","@id":"https:\/\/www.indataipm.com\/#\/schema\/person\/31ac2144f306e999a05ada27d5434beb","name":"David Csiki","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.indataipm.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/1257edd5d055e5cd9d3ceed07b6b48fd6a252570d3e5a987df87f403e2fb1a9e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1257edd5d055e5cd9d3ceed07b6b48fd6a252570d3e5a987df87f403e2fb1a9e?s=96&d=mm&r=g","caption":"David Csiki"},"description":"David Csiki is the Managing Director and President of INDATA, a leading industry provider of software and services for buy-side firms including trade order management (OMS), compliance, portfolio accounting, and front-to-back office technology solutions. Prior to joining INDATA, Csiki was Manager of Marketing and Investor Relations at NYFIX, Inc. and was instrumental in developing the product concept and planning the successful launch of the company\u2019s flagship product, NYFIX, a FIX broker network.","sameAs":["https:\/\/www.linkedin.com\/in\/david-csiki-0a59799"],"url":"https:\/\/www.indataipm.com\/author\/csiki\/"}]}},"_links":{"self":[{"href":"https:\/\/www.indataipm.com\/wp-json\/wp\/v2\/posts\/982","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.indataipm.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.indataipm.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.indataipm.com\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.indataipm.com\/wp-json\/wp\/v2\/comments?post=982"}],"version-history":[{"count":4,"href":"https:\/\/www.indataipm.com\/wp-json\/wp\/v2\/posts\/982\/revisions"}],"predecessor-version":[{"id":8257,"href":"https:\/\/www.indataipm.com\/wp-json\/wp\/v2\/posts\/982\/revisions\/8257"}],"wp:attachment":[{"href":"https:\/\/www.indataipm.com\/wp-json\/wp\/v2\/media?parent=982"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.indataipm.com\/wp-json\/wp\/v2\/categories?post=982"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.indataipm.com\/wp-json\/wp\/v2\/tags?post=982"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}