In just a few years, there has been an explosion in the development and application of generative AI and large language models (LLMs), which have become the way people work, create, and interact with technology and others. AI is everywhere and growing.
To stay on top of this emerging, game-changing technology, Carnegie Mellon University (CMU) has launched a new online graduate certificate in generative AI and large language models. Faculty from CMU's School of Computer Science will teach the latest and most advanced technologies in generative AI, large language models, and multimodal machine learning.
Professor Carolyn Rose, director of the certificate program and professor of the Institute for Human-Computer Interaction and Language Technology, believes that generative AI is reshaping the technology landscape. If students want to contribute to the future development of this field and make an immediate impact in the organization, now is the time to elevate these expertise.
Generative AI and large language models became mainstream in late 2022, when the first chatbots powered by these tools were released. More models, chatbots, and image and video creators quickly followed. CMU's School of Computer Science has been using generative AI and large language models for years, and professors developed these tools, discovered their early applications, and continued to drive their safe, secure, ethical, and responsible use as they evolved.
It is a 12-month program that includes three graduate-level credit courses. In online courses taught live by world-renowned teachers, program participants will develop foundational skills to understand, use and adapt existing tools and techniques; Explore basic mathematical concepts in machine learning and deep learning; Learn how to design and implement scalable LLMs systems. Applicants should have a degree in computer science or related field, be proficient in applied mathematics and statistics, have expertise in Python programming, and experience in machine learning and deep learning.
The course will teach students to implement state-of-the-art language models such as GPT and LLaMA from scratch; Use popular frameworks such as HuggingFace for model training and inference; design and run generative AI systems on high-performance computer infrastructure using tools such as SLURM; Understand and be able to apply algorithms and system techniques to efficiently train LLMs on massive datasets, including efficient fine-tuning and reinforcement learning using human feedback, acceleration on GPUs and other hardware, compression of models for deployment, and online system maintenance.
The Generative AI and Large Language Models Graduate Certificate is offered entirely online to meet the busy schedule of students as professionals. In addition to weekly online interactive lessons taught by CMU instructors, individual time will be used to complete hands-on learning activities that complement classroom discussions.