Home Glossary YARN (Yet Another Resource Negotiator)

YARN (Yet Another Resource Negotiator)

YARN, meaning Yet Another Resource Negotiator, is the resource-management and job-scheduling layer of Apache Hadoop. It separates cluster resource allocation from data-processing logic, allowing multiple frameworks and workloads to share the same computing infrastructure. A resource manager assigns capacity, node managers supervise individual machines, and application masters coordinate specific jobs. Data engineering and machine learning teams can use YARN to schedule distributed preprocessing, training, or analytics close to large datasets. Performance depends on queue policies, memory and CPU requests, data locality, failure recovery, and cluster configuration. Modern cloud and container platforms offer alternatives, but YARN remains relevant in established Hadoop environments and large enterprise data systems.

Related News

Andrew Tulloch Leaves $12B AI Startup to Join Meta After Turning Down $1.5B Offer
By • 3 mins read
AI & Machine Learning, Immersive Reality (AR, VR, MR, and XR), News, Startups & Investment

Andrew Tulloch Leaves $12B AI Startup to Join Meta After Turning Down $1.5B Offer

By • 3 mins read

Andrew Tulloch, co-founder of the $12 billion AI startup Thinking Machines Lab, has joined Meta after previously rejecting what reports described as a $1.5 billion offer — a figure Meta has since called ‘inaccurate and ridiculous.’