Follow BigDATAwire:

Tag: LinkedIn

LinkedIn Centralizing Data Plumbing with Kafka

As company data grows, so too grows the complexity of the data-stream. This can lead to a convoluted crisscross of specialized pipelines that don’t scale or play well with each other. Recently at the Hadoop Summit, engineer, Joel Koshy discussed how LinkedIn attacked this problem and built a real-time data pipeline that they manage to keep current across geography in their disparate datacenters. Read more…

Inside LinkedIn’s Expanding Data Universe

This week we spent some time with LinkedIn team lead, data scientist and economist, Scott Nicholson to get a sense of what possibilities the big data of 150 million users present. We were able to get behind the scenes of the infrastructure and diverse stack (it's more than just Hadoop), and to tap into some visualizations that would make even a seasoned economist... Read more…

BigDATAwire