Project Details

Intelligent Management Platform for Advanced Real-Time media processes

Project Period: 1. 11. 2012 - 31. 10. 2015

Project Type: grant

Code: 7E13044, 316564

Agency: Information and Communication Technologies (ICT) 7th Framework programme

Program: Sedmý rámcový program Evropského společenství pro atomovou energii (Euratom) v oblasti jaderného výzkumu a vzdělávání

Czech title
IMPART - Intelligent Management Platform for Advanced Real-Time media processes
Type
grant
Keywords

information management; multimodal; metadata; real-time decision support; digital media

Abstract

IMPART will research, develop and evaluate intelligent information management solutions for "big data" problems in the field of digital cinema production. It will find new ways of managing, visualising and analysing very large multimodal data sets so that creative personnel can review three-dimensional scene representations on the set, understand the data, identify errors, evaluate the quality of the shot and take creative decisions in real time. We will research and test solutions for the use case of large-scale movie production, with very large research and evaluation datasets based on the latest industrial processes. Results will be applicable to film production and more generally to commercial and professional domains ranging from TV and on-line video to surveillance. The project outcomes will include: - Architectures and file structures for intelligent multimodal data and metadata management, presentation and browsing linking data, metadata and advanced applications - Methods for automatically selecting relevant subsets of data to allow rapid processing - Techniques for processing, information extraction and analysis in distributed systems - Multimodal content semantic and low-level analysis techniques for the automatic derivation of metadata to support visualisation, decision support, management and retrieval - On-set decision support, including tools for multimodal data visualisation, data summarization, layout, registration and cross-referencing, data and metadata search, virtual overlays and real-time previews of effects, creative and technical decision support - A demonstrator system for professional testing and evaluation, both on and off set - A documented xml interface that allows third parties to develop compatible tools and processes - A published test dataset of multimodal data and metadata captured in realistic film production conditions for use by other researchers.

Team members
Smrž Pavel, doc. RNDr., Ph.D. (UPGM FIT VUT) , research leader
Zemčík Pavel, prof. Dr. Ing. (UPGM FIT VUT) , team leader
Ila Viorela S., Ing., Ph.D. (UPGM FIT VUT)
Kula Michal, Ing., Ph.D. (UPGM FIT VUT)
Polok Lukáš, Ing. (UPGM FIT VUT)
Seeman Michal, Ing., Ph.D. (UPGM FIT VUT)
Šolony Marek, Ing., PhD. (UPGM FIT VUT)
Publications

2018

  • BAŘINA David and ZEMČÍK Pavel. Vectorization and Parallelization of 2-D Wavelet Lifting. Journal of Real-Time Image Processing, vol. 15, no. 2, 2018, pp. 349-361. ISSN 1861-8200. Detail

2017

  • ILA Viorela S., POLOK Lukáš, ŠOLONY Marek and SVOBODA Pavel. SLAM++-A Highly Efficient and Temporally Scalable Incremental SLAM Framework. The International Journal of Robotics Research, vol. 2017, no. 1, pp. 210-230. ISSN 1741-3176. Detail

2015

  • POLOK Lukáš, ŠOLONY Marek, ILA Viorela S., SMRŽ Pavel, ZEMČÍK Pavel, CLIFFORD Jeff and PABST Simon. A GPU-Accelerated Bundle Adjustment Solver. San Jose: NVIDIA, 2015. Detail
  • BLAT Josep, EVANS Alun, KIM Hansung, IMRE Evren, POLOK Lukáš, ILA Viorela S., NIKOLAIDIS Nikos, ZEMČÍK Pavel, TEFAS Anastasios, SMRŽ Pavel, HILTON Adrian and PITAS Ioannis. Big Data Analysis for Media Production. IEEE Communication Letters, vol. 104, no. 11, 2015, pp. 2085-2113. ISSN 1089-7798. Detail
  • ŠOLONY Marek, IMRE Evren, ILA Viorela S., POLOK Lukáš, KIM Hansung and ZEMČÍK Pavel. Fast and Accurate Refinement Method for 3D Reconstruction from Stereo Spherical Images. In: Proceedings of the 10th International Conference on Computer Vision Theory and Applications. Berlin: Institute of Electrical and Electronics Engineers, 2015, pp. 1-8. ISBN 978-989-8425-47-8. Detail
  • ILA Viorela S., POLOK Lukáš, ŠOLONY Marek, ZEMČÍK Pavel and SMRŽ Pavel. Fast Covariance Recovery in Incremental Nonlinear Least Square Solvers. In: Proceedings of IEEE International Conference on robotics and Automation. Seattle: IEEE Computer Society, 2015, pp. 1-8. ISBN 978-1-4799-6922-7. Detail
  • POLOK Lukáš, ILA Viorela S. and SMRŽ Pavel. Fast Sparse Matrix Multiplication on GPU. In: Proceedings of the 23rd High Performance Computing Symposium (HPC'15). Alexandria, Virginia: Association for Computing Machinery, 2015, pp. 1-8. ISBN 978-1-5108-0101-1. Detail
  • BLAT Josep, EVANS Alun, HILTON Adrian, IMRE Evren, KIM Hansung, NIKOLAIDIS Nikos, PITAS Ioannis, POLOK Lukáš, SMRŽ Pavel, TEFAS Anastasios and ZEMČÍK Pavel. IMPART: Big media data processing and analysis for film production. In: IEEE International Conference on Multimedia Expo Workshops (ICMEW). Torino, 2015, pp. 1-5. ISBN 978-1-4799-7079-7. Detail
  • PABST Simon, KIM Hansung, POLOK Lukáš, ILA Viorela S., WAINE Ted, HILTON Adrian, CLIFFORD Jeff and SMRŽ Pavel. Jigsaw - Multi-Modal Big Data Management in Digital Film Production. Los Angeles, 2015. ISBN 978-1-4503-3632-1. Detail
  • POLOK Lukáš, KLICNAR Lukáš, ZEMČÍK Pavel, BERAN Vítězslav and SMRŽ Pavel. Quality Assurance in Large Collections of Video Sequences. In: Proceedings - International Conference on Image Processing, ICIP. Québec: IEEE Computer Society Press, 2015, pp. 3580-3584. ISBN 978-1-4799-8339-1. Detail
  • POLOK Lukáš, VINCENT Lui W., ILA Viorela S., DRUMMOND Tom and MAHONY Robert. The effect of different parameterisations in incremental structure from motion. In: Proceedings of 2015 Australasian Conference on Robotics and Automation, ACRA 2015; Australian National UniversityCanberra; Australia. Canberra: Australian National University, 2015, pp. 1-9. ISSN 1448-2053. Detail

2014

  • BAŘINA David and ZEMČÍK Pavel. Diagonal Vectorisation of 2-D Wavelet Lifting. In: International Conference on Image Processing (ICIP). Paris: IEEE Signal Processing Society, 2014, pp. 2978-2982. ISBN 978-1-4799-5751-4. Detail
  • POLOK Lukáš, ILA Viorela S. and SMRŽ Pavel. Fast Radix Sort for Sparse Linear Algebra on GPU. In: Proceedings of the 22nd High Performance Computing Symposium (HPC'14). Tampa: Association for Computing Machinery, 2014, pp. 1-8. ISBN 1-56555-353-5. Detail
  • BAŘINA David, ZAHRÁDKA Jiří and ZEMČÍK Pavel. Wavelet Representation of Optical System Distortion. In: International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG). Plzeň: Union Agency, 2014, pp. 11-16. ISBN 978-80-86943-71-8. Detail

2013

  • POLOK Lukáš, ILA Viorela S. and SMRŽ Pavel. Cache Efficient Implementation for Block Matrix Operations. In: Proceedings of the 21st High Performance Computing Symposium (HPC'13). San Diego: Association for Computing Machinery, 2013, pp. 698-706. ISBN 1-56555-350-0. Detail
  • VRÁBELOVÁ Pavla, BAŘINA David, ŠKODA Petr, ZENDULKA Jaroslav and VÁŽNÝ Jaroslav. Classification of Be Stars Using Feature Extraction Based on Discrete Wavelet Transform. In: Proceedings of conferences Datakon and Znalosti 2013. Ostrava: VŠB-Technical University of Ostrava, 2013, pp. 95-102. ISBN 978-80-248-3189-3. Detail
  • VRÁBELOVÁ Pavla, BAŘINA David, ŠKODA Petr, VÁŽNÝ Jaroslav and ZENDULKA Jaroslav. Classification of Spectra of Emission-line Stars Using Feature Extraction Based on Wavelet Transform. In: Proceedings of 23rd Annual Astronomical Data Analysis Software and Systems (ADASS) Conference. San Francisco: Astronomical Society of the Pacific, 2013, pp. 177-180. ISBN 978-1-58381-854-1. Detail
  • ILA Viorela S., POLOK Lukáš, SMRŽ Pavel, ŠOLONY Marek and ZEMČÍK Pavel. Incremental Block Cholesky Factorization for Nonlinear Least Squares in Robotics. In: In proceedings of The Robotics: Science and Systems 2013 Conference. Berlín: MIT Press, 2013, pp. 1-8. ISBN 978-981-07-3937-9. Detail
  • ILA Viorela S., POLOK Lukáš, SMRŽ Pavel, ŠOLONY Marek and ZEMČÍK Pavel. Incremental Cholesky Factorization for Least Squares Problems in Robotics. In: Proceedings of The 2013 IFAC Intelligent Autonomous Vehicles Symposium. Gold Coast: IEEE Computer Society, 2013, pp. 1-8. ISBN 978-3-902823-36-6. Detail
  • BAŘINA David and ZEMČÍK Pavel. Minimum Memory Vectorisation of Wavelet Lifting. In: Advanced Concepts for Intelligent Vision Systems (ACIVS). Lecture Notes in Computer Science (LNCS) 8192, vol. 8192. Poznan: Springer London, 2013, pp. 91-101. ISBN 978-3-319-02894-1. Detail
  • BAŘINA David and ZEMČÍK Pavel. Wavelet Lifting on Application Specific Vector Processor. In: GraphiCon'2013. Vladivostok: GraphiCon Scientific Society, 2013, pp. 83-86. ISBN 978-5-8044-1402-4. Detail
Products

2015

  • Video Synchronization Tool, software, 2015
    Authors: Klicnar Lukáš, Beran Vítězslav, Polok Lukáš, Bařina David, Smrž Pavel, Zemčík Pavel Detail

2014

  • Framework for Wavelet Representation of Optical System Distortion, software, 2014
    Authors: Bařina David, Zahrádka Jiří, Zemčík Pavel Detail
  • In-Focus detector, software, 2014
    Authors: Seeman Michal, Bařina David, Polok Lukáš, Smrž Pavel, Zemčík Pavel Detail

2013

  • Accelerated DPX decoder, software, 2013
    Authors: Ila Viorela S., Polok Lukáš, Seeman Michal, Smrž Pavel, Svoboda Aleš, Šolony Marek, Zemčík Pavel Detail
  • GPU Accelerated Similarity Matrix Module, software, 2013
    Authors: Ila Viorela S., Polok Lukáš, Smrž Pavel, Svoboda Pavel, Šolony Marek, Zemčík Pavel Detail
  • SNAPPER Image Postprocess, software, 2013
    Authors: Ila Viorela S., Polok Lukáš, Seeman Michal, Smrž Pavel, Šolony Marek, Zemčík Pavel Detail
Back to top