SAP’s David Parker gave this webcast to ASUG this past week. He covered why big data apparent in marketplace and what the next generation of architecture looks like.
Figure 1: Source: SAP
Figure 1 covers Big Data today. There is an “immense amount of big data”.
Quote from Boeing: “these engines generate 1 TB of data per day”
From the ground crew, cargo, data is tracked to where things are going, including checking the passenger list
It generates TB’s of data, different speeds, rates, structured and unstructured
Figure 2: Source: SAP
Figure 2 covers economics of scale – opportunity to explore data using the airline industry
Architects and technologists need to look at this and look at data sources such as streaming, fencing, mobile, social data. They also need to look ahead and how business will look for next generation architecture. This includes machine to machine data, social media, and sales data
Figure 3: Source: SAP
Apache Hadoop was referred to as the “Community gift” given it is open source
Figure 4: Source: SAP
Figure 4 shows that the trend is more than just Hadoop. It includes in memory – “evolutionary and revolutionary HANA"
Figure 5: Source: SAP
Figure 5 shows merging with a distributed file structure
David said he couldn’t remember when last saw Iron Mountain truck to store tapes/papers, as most of it can be online, moving batch to real time environment
Figure 6: Source: SAP
Figure 6 shows BusinessObjects/Sybase, SuccessFactors
The platform can connect any client GUI – ODBC, JDBC
On the left is Event Stream Processing, with acquiring streaming events of data, hundreds of thousands per second, 1 million events per second load to HANA and it can do complex calculations
Sybase ASE is a relational database, ported application suite on ASE
Replication Server has the capability to do log capturing:
- Oracle to Oracle
- DB2 to DB2
It allows you to simplify architecture
On the right is SQLA – small footprint database; similar to MySQL
It is fully compliant, ACID compliant
You can use it on a handheld device
SAP IQ has a nearline storage with BW on HANA – own native solution
Data Services is part of EIM framework – data quality, security, cleansing before load
The HANA platform is for “any data, any velocity, speed, volume” and is the “next generation architecture”
Figure 7: Source: SAP
Hadoop has its own operating system – YARN – intention is to have HANA operate with that
The suggestion was to move HOT data to HANA (live real-time access) with less volatile data put in SAP IQ
Larger volumes of data can be loaded to Hadoop – in VM
Deployment options can be to cloud, or appliance on premise – OpEx vs CapEx spending (I think this is the first time I truly understood this term)
Figure 8: Source: SAP
Figure 8 shows the HANA platform. It is optimized to run in memory
The speaker said you don’t have to “worry about position data to disk”
Processing engines in HANA – ESP, planning engine, calculation engine, build calc engine in HANA. Predictive capabilities come in 3 forms – 1) BusinessObjects suite 2) KXEN and now KXEN runs on HANA, 3) SAS partnership
The HANA platform can do text mining, extending geo spatial with ESRI with a wide range of applications
Figure 9: Source: SAP
The slide on the right of Figure 9 is cut off.
In the past we used DBA skills, application development, middleware and it took 7 to 9 months in a project. This is not agile; we were “constrained by technology” and lacked insight
Part 2 will review use cases, question and answer and more.
Upcoming ASUG Big Data Webcasts:
- June 16: Learn How to Process Big Data Faster Using the Power of SAP Data Services 4.2 and SAP HANA
- August 5: Harness the Big Data Monster - Make it Work for You
Upcoming ASUG Enterprise Architecture-related webcasts:
- May 20: Enterprise Architecture Best Practices
- June 19: Business Modeling and Architecture for Business Process Orchestration
- June 24: What's the Future of Architecture Modeling Tools
- June 26: SAP PowerDesigner: Gartner EA MQ Leader: Why Not Use the Industry Leader for Your EA Implementation?
- July 8: Using SAP PowerDesigner to Integrate SAP Solutions into Your Enterprise
ASUG Annual Conference
Learn more about Big Data from customer sessions at ASUG Annual Conference:
Adobe Shares Managing Big Data Across a Logical Data Warehouse with SAP HANA, SAP IQ, and Hadoop
Norwegian Cruise Line’s Industry-Leading Blueprint to Leverage Big Data for Competitive Advantage
Also learn about "Big Data" or HANA from the following ASUG Pre-conference sessions:
Jump Start ASUG Annual Conference SAPPHIRE with a Pre-Conference Session - Back and Better than Ever
In-depth sessions on EIM at ASUG Annual Conference: Try a pre-con!
If you have a big data story to share, ASUG invites you to submit an abstract for SAP dcode for Las Vegas (aka SAP TechEd) - call for sessions is open now through May 25th - follow this link to create a speaker account where you can formally submit your proposal, review important deadlines, and other general information about SAP d-code.
- SAP Managed Tags:
