A seminar was held for students of Azerbaijan Technical University (AzTU), organized by the Department of Engineering Mathematics and Artificial Intelligence, featuring Mohammad Valiyev, a Senior Software Engineer at Databricks, one of the world’s leading companies in Big Data.
The seminar, attended by bachelor’s, master’s, and PhD students studying computer science, computer engineering, and information security, focused on the “Apache Spark” software. Detailed information was provided about its internal components (execution model, stages, tasks) and its application in solving various problems, including audio and video file analysis.
The seminar also covered how to store large volumes of data in cloud technology (e.g., Amazon S3) in Delta Lake format, the internal file structure of Delta Lake, and comparisons with other formats like Apache Iceberg.
RELATED GOALS