Hadoop vs Spark

The cluster centers on debates comparing a discussed tool or approach to Hadoop, frequently questioning its advantages over Hadoop and positioning Spark as a faster, memory-based replacement for MapReduce while arguing Hadoop is often overkill or outdated.

📉 Falling 0.5x DevOps & Infrastructure
4,254
Comments
20
Years Active
5
Top Authors
#6587
Topic ID

Activity Over Time

2007
8
2008
71
2009
175
2010
176
2011
256
2012
255
2013
320
2014
325
2015
417
2016
393
2017
287
2018
236
2019
319
2020
218
2021
244
2022
123
2023
135
2024
169
2025
103
2026
24

Keywords

MapReduce HDFS AI CPU SQL HADOOP HIVE ML ODBC JDBC hadoop spark big data data sql clusters hive suits processing data sets

Sample Comments

kevinburke • Aug 20, 2021 • View on HN

How is this better than Hadoop?

t-crayford • Oct 22, 2012 • View on HN

How is this better than Hadoop?

FollowSteph3 • Oct 20, 2011 • View on HN

Why is this better than Hadoop?

growse • Apr 22, 2015 • View on HN

Spark is a good replacement for MapReduce. MapReduce != Hadoop.

kwillets • May 25, 2017 • View on HN

Because he's using Hadoop :P

Rokks • Jul 18, 2011 • View on HN

What do you see as being better than hadoop?

rjurney • May 23, 2017 • View on HN

Don't use Hadoop even if your data is big. Spark replaced it.

merb • Sep 4, 2016 • View on HN

Guess that's impossible without Spark or Hadoop.

robluxus • Jan 8, 2023 • View on HN

Obligatory "you don't need Hadoop": https://news.ycombinator.com/item?id=14401399

kevinburke • Nov 15, 2022 • View on HN

Seems neat, but why is this better than Hadoop?