Course details
Multimedia
MUL Acad. year 2022/2023 Summer semester 5 credits
Definition of multimedia technology, multimedia peripheral devices, connection between signal processing and multimedia, digital signal processors and their features, "case study" of system design with digital signal processor, Windows sound, video, and raster operation API, formats for image and sound digitization, formats for image and sound encoding, image compression, video compression, sound compression, DirectX raster operations, DirectX sound, OpenGL raster operations, multimedia programming interfaces.
Guarantor
Course coordinator
Language of instruction
Completion
Time span
- 26 hrs lectures
- 13 hrs pc labs
- 13 hrs projects
Assessment points
- 51 pts final exam (15 pts written part, 36 pts test part)
- 10 pts mid-term test (test part)
- 10 pts numeric exercises
- 29 pts projects
Department
Lecturer
Instructor
Subject specific learning outcomes and competences
The students will learn and understand basic methods of image processing and sound processing as 2D and 1D digital signals. They will get acquainted with compression and decompression methods for image and sound data in PC environment. They will also learn how to exploit programmers interfaces' for image and sound and get acquainted with data formats for image and sound representation and with basic features of digital signal processors. They will learn about raster operations in Windows API, DirectX, and OpenGL and with sound interfaces of Windows API and DirectX, too. Finally, they will get acquainted with the anticipated development of multimedia data processing.
The students will learn to search team partners, to work in team, and to defend their work in public. They will also improve their skills in development tools usage and also in practical C/C++ programming.
Learning objectives
To learn and understand basic methods of image processing and sound processing as 2D and 1D digital signals. To get acquainted with compression and decompression methods for image and sound data in PC environment. To learn how to exploit programmers' interfaces for image and sound. To get acquainted with data formats for image and sound representation. To get acquainted with basic features of digital signal processors. To learn about raster operations in Windows API, DirectX, and OpenGL and sound interfaces of Windows API and DirectX. To get acquainted with the anticipated development of multimedia data processing.
Recommended prerequisites
Prerequisite knowledge and skills
Basic knowledge of C/C++ programming, basics of signal processing.
Study literature
- Study support "Multimedia" (in Czech) to download
- IEEE Multimedia, IEEE, USA – various articles
- Wodtke, M.: Mind Over Media, McGraw-Hill, New York, USA, 1993, ISBN 0-07-067633-X
- Yun Q. Shi, Huifang Sun. Image and Video Compression for Multimedia Engineering: Fundamentals, Algorithms, and Standards. CRC Press, 1999. ISBN 978-1-4200-4979-8
- Simon, R. J.: Multimedia & ODBC API Bible, Watte Group Press, Carte Madera, CA, USA, 1996, ISBN 1-57169-011-5
- John Watkinson. The MPEG Handbook. CRC Press, 2012. ISBN 978-1-136-02898-6
- David Salomon, Giovanni Motta. Handbook of Data Compression. Springer, 2010. ISBN 978-1-84882-902-2
- Iain E. G. Richardson. H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia. John Wiley & Sons, 2003. ISBN 978-0-470-86960-7
Syllabus of lectures
- Úvod, Kompresní techniky (8. 2. 2023, slajdy, slajdy)
- Zpracování signálu (15. 2. 2023)
- Filtrace (22. 2. 2023, slajdy)
- Principy komprese obrazu a videa (1. 3. 2023, slajdy)
- Zvuková rozhraní (8. 3. 2023, slajdy)
- Zvukové formáty (15. 3. 2023, slajdy, nové slajdy)
- Formáty obrazu (22. 3. 2023, slajdy)
- Formáty videa (29. 3. 2023, slajdy)
- Multimediální frameworky (5. 4. 2023, slajdy), půlsem. test
- Vulkan (12. 4. 2023)
- OpenGL (19. 4. 2023, slajdy)
- Formáty a technologie TV (26. 4. 2023, slajdy)
- Závěr, DSP use case (3. 5. 2023, slajdy)
Syllabus of computer exercises
- Introductory lab, introduction to tools
- Sound filter design and implementation
- JPEG compression - DCT settings
- Multimedia framework FFmpeg
- Shaders
- OpenGL
Syllabus - others, projects and individual work of students
- Individually assigned examples for the duration of the course
Progress assessment
Mid-term test, evaluated computer exercises, and individual project.
Controlled instruction
The monitored teaching activities include mid-term test, evaluated computer exercises, individual project, and final exam. The mid-term test does not have correction option, the final exam has two possible correction terms.
Course inclusion in study plans
- Programme IT-MGR-2, field MBI, MBS, MIN, MMM, MPV, MSK, any year of study, Elective
- Programme IT-MGR-2, field MGM, 1st year of study, Compulsory
- Programme IT-MGR-2, field MIS, any year of study, Compulsory-Elective group S
- Programme MITAI, field NADE, NBIO, NCPS, NEMB, NEMB up to 2021/22, NHPC, NIDE, NISD, NISY, NISY up to 2020/21, NMAL, NMAT, NNET, NSEC, NSEN, NSPE, NVER, NVIZ, any year of study, Elective
- Programme MITAI, field NGRI, any year of study, Compulsory