Technology Keynote Speaker:
![](https://ieeecai.org/2024/wp-content/uploads/2024/05/Joseph-Yang-1.png)
AI Native Architectures and considerations for Generative AI
Joseph YANG
General Manager, Hewlett Packard Enterprise
Date: 25 June, 2024
Time: 10:30 am – 11:00 am
Venue: Melati Ballroom
Abstract:
Current cloud native datacenter architectures are not enough to support the demands of Artificial Intelligence, and in particular Generative AI and the large models that allow Generative AI to happen. The demands of Generative AI don’t just impact the infrastructure required to train LLMs but also the infrastructure for running day to day inference. This revolution in infrastructure demand also has sustainability implications as well. Luckily a lot of the problems in building AI Native infrastructure is not new, and have actually been encountered and solved as part of building the largest supercomputers in the world.
HPE will go into, how the requirements for AI will continue to push the limits of datacenter architecture, as well as how HPE is taking lessons learnt from building the only 2 Exascale Supercomputers in the world and applying them to the world of AI.
Biography:
Joseph currently leads the HPC and AI business at Hewlett Packard Enterprise across Asia Pacific and India. In this role he is helping cus-tomers transform their business with AI at Scale solutions leveraging HPE’s leadership position in the SuperComputing space and translat-ing that to accelerating our customers’ AI journey. In the past 5 years at HPE, Joseph has held various leadership positions, including lead-ing the Storage business for HPE in Asia Pacific as well as being the Managing Director owning the end-to-end business in Singapore.
Prior to HPE, Joseph was CTO and Director of Professional and Man-aged Services at Microware Limited in Hong Kong, one of the largest IT resellers in the Hong Kong market and a close HPE partner. During his time at Microware he helped the company achieve many “indus-try firsts” in the Hong Kong market including driving the adoption of virtualization and data centre automation as well as Cloud managed services.
Joseph has over 25 years’ experience in the IT industry both at the helm of Microware in Hong Kong as well as in the US market; having worked directly with Fortune 500 customers developing B2B sales enablement and e-commerce solutions at an industry leading ven-dor.