Pregled bibliografske jedinice broj: 1122284
Using Hadoop Ecosystem and Python to Explore Climate Change
Using Hadoop Ecosystem and Python to Explore Climate Change // Recent Trends in Signal and Image Processing, 1333 (2021), 105-113 doi:10.1007/978-981-33-6966-5_11 (međunarodna recenzija, članak, stručni)
CROSBI ID: 1122284 Za ispravke kontaktirajte CROSBI podršku putem web obrasca
Naslov
Using Hadoop Ecosystem and Python to Explore Climate Change
Autori
Šušnjara, Ivan Ksaver ; Hlupić, Tomislav
Izvornik
Recent Trends in Signal and Image Processing (2194-5357) 1333
(2021);
105-113
Vrsta, podvrsta i kategorija rada
Radovi u časopisima, članak, stručni
Ključne riječi
Apache Hadoop ; Apache Hive ; Python ; Climate change
Sažetak
In this article, the data storing and processing capabilities of Apache Hadoop ecosystem, and its components: Hive, Impala and Sqoop are demonstrated. Also, it demonstrates Python programming language’s capabilities in data analysis, plotting and statistical computing. It does so by exploring climate change problem, one of today’s most relevant and detrimental problems. Apache Sqoop was employed to migrate data from RDBMS system and store it into Hive database, where Hive and Impala were used for data processing and ELT. Finally, data was analyzed using Python, showing strong evidence for global warming presence, as well as exploring relationship between carbon dioxide (CO2 ) emissions and climate change.
Izvorni jezik
Engleski
Znanstvena područja
Računarstvo, Informacijske i komunikacijske znanosti
Citiraj ovu publikaciju:
Časopis indeksira:
- Scopus