How to Ingest Data in Hadoop
Load files, database tables and event streams into HDFS with the HDFS shell, WebHDFS, DistCp, Spark JDBC and Kafka, now that Sqoop is retired and Flume is dormant.
#big-data#hdfs
Tanishk · 7 min
Topic
Load files, database tables and event streams into HDFS with the HDFS shell, WebHDFS, DistCp, Spark JDBC and Kafka, now that Sqoop is retired and Flume is dormant.
#big-data#hdfs
Understand the four NoSQL families (key-value, document, wide-column and graph), see a working example of each, and learn what each one makes you give up.
#big-data#nosql
See what became of the 2016 Hadoop stack and what replaced it: object storage, Iceberg and Delta Lake tables, lakehouses and cloud SQL warehouses.
#big-data
Understand what big data means, how to tell whether your data really needs distributed tools, and which categories of big data technology are in use today.
#big-data