Apache CarbonData+Spark to realize data convergence and Unified high performance Data Analytics

Raghunandan Subramanya

Chief Architect

Huawei Technologies India Pvt Ltd

About Raghunandan Subramanya

Raghunandan is the Chief Architect at Huawei's India R&D center's BigData practice at Bengaluru, where he leads the team on BigData technologies including Spark, Hadoop, HBase, CarbonData & ZooKeeper. He is one of the core members who to open source CarbonData. He is also a committer of Apache CarbonData and in past, he leads the CarbonData delivery team at Huawei and contributed to CarbonData to graduate to Top Level Project successfully in Apache community. Raghunandan has previously worked on BI, NMS, and Softswitch at Huawei.


Session

Challenges in Data Analytics:
Different application scenarios need different storage solutions: HBASE is ideal for point query scenarios but unsuitable for multi-dimensional queries. MPP is suitable for data warehouse scenarios but engine and data are coupled together which hampers scalability. OLAP stores used in BI applications perform best for Aggregate queries but full scan queries perform at a sub-optimal performance. Moreover, they are not suitable for real-time analysis. These distinct systems lead to low resource sharing and need different pipelines for data and application management.

Share the talk