Home

Sloppy Use of Machine Learning Is Causing a ‘Reproducibility Crisis’ in Science

Leave a comment

Click the link below the picture

.

History shows civil wars to be among the messiest, most horrifying of human affairs. So Princeton professor Arvind Narayanan and his Ph.D. student Sayash Kapoor got suspicious last year when they discovered a strand of political science research claiming to predict when a civil war will break out with more than 90 percent accuracy, thanks to artificial intelligence.

A series of papers described astonishing results from using machine learning, the technique beloved by tech giants that underpins modern AI. Applying it to data such as a country’s gross domestic product and unemployment rate was said to beat more conventional statistical methods at predicting the outbreak of civil war by almost 20 percentage points.

Yet when the Princeton researchers looked more closely, many of the results turned out to be a mirage. Machine learning involves feeding an algorithm data from the past that tunes it to operate on future, unseen data. But in several papers, researchers failed to properly separate the pools of data used to train and test their code’s performance, a mistake termed “data leakage” that results in a system being tested with data it has seen before, like a student taking a test after being provided the answers.

“They were claiming near-perfect accuracy, but we found that in each of these cases, there was an error in the machine-learning pipeline,” says Kapoor. When he and Narayanan fixed those errors, in every instance they found that modern AI offered virtually no advantage.

.

Photograph: PM Images/Getty Images

.

.

Click the link below for the article:

https://www.wired.com/story/machine-learning-reproducibility-crisis/?utm_source=pocket_discover

.

__________________________________________

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.

TradingClubsMan

Algotrader at TRADING-CLUBS.COM

Comedy FESTIVAL

Film and Writing Festival for Comedy. Showcasing best of comedy short films at the FEEDBACK Film Festival. Plus, showcasing best of comedy novels, short stories, poems, screenplays (TV, short, feature) at the festival performed by professional actors.

Bonnywood Manor

Peace. Tranquility. Insanity.

Warum ich Rad fahre

Take a ride on the wild side

Madame-Radio

Découvre des musiques prometteuses dans la sphère musicale française (principalement, mais pas que...).

Ir de Compras Online

No tiene que Ser una Pesadilla.

Kana's Chronicles

Life in Kana-text (er... CONtext)

Cross-Border Currents

Tracking money, power, and meaning across borders.

Jam Writes

Where feelings meet metaphors and make questionable choices.

emotionalpeace

Finding hope and peace through writing, art, photography, and faith in Jesus.

Wearing Two Gowns.COM

What to do when your career implodes and your friends betray you!? You say "GOOD!"

...

love each other like you're the lyric to their music

Luca nel laboratorio di Dexter

Comprendere il mondo per cambiarlo.

Tales from a Mid-Lifer

Mid-Life Ponderings

Hunza

Travel,Tourism, precious story "Now in hundreds of languages for you."

freedomdailywriting

I speak the honest truth. I share my honest opinions. I share my thoughts. A platform to grow and get surprised.

The Green Stars Project

User-generated ratings for ethical consumerism

Cherryl's Blog

Travel and Lifestyle Blog

Sogni e poesie di una donna qualunque

Questo è un piccolo angolo di poesie, canzoni, immagini, video che raccontano le nostre emozioni

My Awesome Blog

“Log your journey to success.” “Where goals turn into progress.”

pierobarbato.com

scrivo per dare forma ai silenzi e anima alle storie che il mondo dimentica.

Thinkbigwithbukonla

“Dream deeper. Believe bolder. Live transformed.”

Vichar Darshanam

Vichar, Motivation, Kadwi Baat ( विचार दर्शनम्)

Komfort bad heizung

Traum zur Realität

Chic Bites and Flights

Savor. Style. See the world.

ومضات في تطوير الذات

معا نحو النجاح

Broker True Ratings

Best Forex Broker Ratings & Reviews

Blog by ThE NoThInG DrOnEs

art, writing and music by James McFarlane and other musicians

fauxcroft

living life in conscious reality

Srikanth’s poetry

Freelance poetry writing

JupiterPlanet

Peace 🕊️ | Spiritual 🌠 | 📚 Non-fiction | Motivation🔥 | Self-Love💕

Sehnsuchtsbummler

Reiseberichte & Naturfotografie

Spotlight Choices

astrology - life coaching - optimistic reality

INFINITE ENERGY

"قوتك تبدأ من هنا"

Mesime ÜNALMIŞ

Her çocuk hikayelerle büyümeli

Treasurable Life: The Dirty, Divine Truth of Becoming

No shame. No filters. Just everything we were told to hide.

Dr. Edward McInnis

Doctor of Medicine

Ishaya Zephaniah

Explore the dynamic relationship between faith and science, where curiosity meets belief. Join us in fostering dialogue, inspiring discovery, and celebrating the profound connections that enrich our understanding of existence.

Through Pain Suffering , Mental Health , Addictions , Cancer , Death , Drs

Living with Purpose: Finding Meaning Amidst Life's Challenges