This project began as a post about a year ago, in which we followed the provenance of the data from a study about misinformation until, at the bottom, we found Media Bias/Fact Check. Upon further examination, it turned out that Media Bias/Fact Check is just some guy, and upon him there rests a surprising amount of academic research. We've since turned this into a study with the following abstract:
Media Bias/Fact Check (MBFC) purports to quantify the bias, credibility, and factuality of reporting for roughly 10,000 media sources, and the resulting data is commonly used in misinformation research. In the present study, we show that MBFC's methodology does not meet basic standards of rigor for academic research. Despite its widespread prevalence, studies using MBFC rarely examine it carefully, often describing it in ways that contradict its "About" page, or treating it as authoritative despite MBFC's disclaimer that it is "not a tested scientific method... [but] a simple guide to the idea of a source's bias." We identified no papers that adequately describe MBFC as the opinions of a single person or critically engage with its methodology in order to justify proceeding with its use. We argue that MBFC's data is not neutral or accurate, but a computationally legible account of hegemony, a specious dataset for uncritical research that mistakes the familiarity of the concepts it quantifies with accuracy. Our study concludes with a call for academic researchers to stop using MBFC. MBFC's data quantifies the results of political processes, including campaigns to discredit the press, and presents them as simple facts about the world, thus reproducing the crisis misinformation scholarship exists to address.
50 Comments
geneva_convenience@lemmy.ml · 25 pts · 30d
MBFC is ran by a Zionist shill. They rate UNWatch which is a straight up Israeli think-tank calling everyone including Francesca Albanese Hamas as "high credibility". And MBFC knows very well that it's a Zionist propaganda cesspool but they use their reputation to endorse it anyway.
This is UNWatch right now:
theluddite@lemmy.ml · 16 pts · 30d
Yeah the whole website is just bullshit. My favorite example of how dumb it is: FAIR.org, the explicitly progressive media watchdog, is rated to the right of New York Times. FAIR frequently critiques the NYT from the left. It's like one of their main things.
geneva_convenience@lemmy.ml · 17 pts · 30d
They really want to keep the illusion that NYT isn't just a right wing imperialist rag alive.
Another great one is the "high credibility" ADL https://mediabiasfactcheck.com/anti-defamation-league/
MBFC is just a hodgepodge of Zionist shilling and pro-US Liberal propaganda. But since all other Liberal "media watchdogs" are basically all the exact same they can all claim to be "fair and unbiased".
Western media really is just
davel@lemmy.ml · 21 pts · 30d
I’ve been saying this for over two years.
Previously:
Previously:
Previously:
ShinkanTrain@lemmy.ml · 10 pts · 30d
Love that Joe Rogan is in the center of that chart.
theluddite@lemmy.ml · 9 pts · 30d
The linked paper has some of the graphs you're looking for, and much analysis that I think you'll like. I even cite both Bernays and Chomsky in the paper. I'm also happy to send you the MBFC data if you'd like. If you want to just get it for yourself, the API has a freemium API tier that only lets you make a handful of requests, but each request gives you the whole dataset, so it's basically free unless you want to keep updating it.
davel@lemmy.ml · 8 pts · 30d
The “spectacle of computation” is a great callback.
If you want to see an example of utter nonsense “data-driven” research, Roll in the Tanks! Measuring Left-wing Extremism on Reddit at Scale. Older versions of the paper had a whole section dedicated to lemmygrad.ml.
Why would they write this? Presumably because that’s where grant money is being directed lately. Previously, three years ago: Atlantic Council: Collective Security in a Federated World
dessalines@lemmy.ml · 9 pts · 29d
We need someone with some Marxist literacy to create a similar project and call it like something equally neutral sounding, like, "media bias credibility meter".
I guess prolewiki already could handle this, but liberals are immediately turned off by the partisan pro-worker viewpoint, and are easily duped by anything that sounds neutral on its cover.
Maeve@kbin.earth · 18 pts · 30d
We've been saying that for years, but good luck!
Zizzy@lemmy.blahaj.zone · 10 pts · 30d
Yep, this was a big thing on lemmy for a bit and the fact it isnt used at all here anymore i think speaks to the general concensus on it
theluddite@lemmy.ml · 7 pts · 30d
I actually had no idea. Can you tell me more about this or maybe dig up some old links? Trying to find some myself but haven't had any luck.
I do know that wikipedia has flagged it as an unreliable source for some time, so big win for wikipedia's editors over peer-review.
geneva_convenience@lemmy.ml · 12 pts · 30d
I found this one and I think there was a lot more. https://lemmy.ml/post/18540211/12622685
A while back .world had MBFC as a required judge for which websites were allowed to be submitted and it led to a lot of drama. They have since basically scrubbed MBFC away which is objectively an improvement.
mrdown@lemmy.world · 10 pts · 30d
They are still ok with jordan deleting posts because the factcheck told him so
theluddite@lemmy.ml · 4 pts · 30d
Really cool. Thanks for digging it up! I will be looking into.
geneva_convenience@lemmy.ml · 8 pts · 30d
No problem. I also tried Googling it but I think Lemmy is fully censored on Google which is... Interesting...
eldavi@lemmy.ml · 7 pts · 30d
Wikipedia is just as problematic so this is more like the pot calling the kettle black.
theluddite@lemmy.ml · 5 pts · 30d
Who is we?
geneva_convenience@lemmy.ml · 10 pts · 30d
It was a big debacle on .world a while back
theluddite@lemmy.ml · 9 pts · 30d
Thank you for bringing this to my attention. Super interesting and looking forward to sharing it with my collaborators. It's fascinating how much more successful internet communities have been at spotting MBFC as bullshit than academics doing peer reviewed research.
Maeve@kbin.earth · 8 pts · 30d
Sane people.
theluddite@lemmy.ml · 8 pts · 30d
Well, now there are at least two of us.
Maeve@kbin.earth · 7 pts · 30d
A lot of people reject it, but zio/nazis.
Oisteink@lemmy.world · -2 pts · 30d
Just maeve i think, but it sounds better that way
QinShiHuangsShlong@lemmy.ml · 18 pts · 30d
Never heard of this site but wow. Beyond parody.
theluddite@lemmy.ml · 16 pts · 30d
Oh wow! I hadn't noticed this one. Absolutely fucking hilarious!
QinShiHuangsShlong@lemmy.ml · 15 pts · 30d
The fact it seems people were taking this clearly joke of a site seriously is concerning however.
BrainInABox@lemmy.ml · 13 pts · 29d
Not just take it seriously, a lot of people treat it as essentially divine truth.
davel@lemmy.ml · 12 pts · 30d
We laugh, but its creator was and is as serious as a heart attack.
So we laugh even harder.
theluddite@lemmy.ml · 10 pts · 30d
Yup! Very concerning!
davel@lemmy.ml · 13 pts · 30d
The reason .world’s admins and @jordanlund@lemmy.world like MB/FC is because it aligns with their hegemonic capitalist, imperial core point of view.
theluddite@lemmy.ml · 11 pts · 30d
100%. That's how it works in the academic misinformation research too. Both MBFC and the researchers are downstream of the same propaganda (as we all are) and lack the curiosity to look beyond it.
davel@lemmy.ml · 9 pts · 30d
There’s a lack of curiosity, but also a paucity of grant money for looking beyond it, because the money comes from the federal government and from non-profits funded by billionaires & corporations.
It is difficult to get a man to understand something, when his salary depends on his not understanding it.
— Upton Sinclair, I, Candidate for Governor: And How I Got Licked
jordanlund@lemmy.world · -7 pts · 29d
I like MBFC because there literally is no other free source measuring both bias and, more importantly, credibility.
Left / Right bias is fine, as long as the site is credible.
I have not yet seen any site they say is credible, but is not, or vice versa, a site they mark questionable that is actually a valid source.
"Medium Credibility" is not something I personally remove, only Questionable.
Examples:
https://mediabiasfactcheck.com/press-tv/
https://mediabiasfactcheck.com/russian-news-agency-tass/
https://mediabiasfactcheck.com/fox-news-bias/
https://mediabiasfactcheck.com/one-america-news-network/
dessalines@lemmy.ml · 9 pts · 29d
MBFC is literally just some guy's opinion blog, there's nothing credible about it. It has the appearance of neutrality on its cover, and 1 page in it comes out as staunchly pro-zionist.
mrdown@lemmy.world · 7 pts · 29d
Jordan is unable to think by himself.
jordanlund@lemmy.world · -2 pts · 28d
Cite your examples, as I did. Find a source that they say is questionable who is solid, or vice versa, a source they say is credible when they are not.
I gave 4 examples.
BrainInABox@lemmy.ml · 8 pts · 29d
It isn't measuring anything though; it doesn't have any kind of methodology for providing a quantitative value. It's just one guy's personal opinion based on vibes.
And how would you even know if it did?
jordanlund@lemmy.world · -4 pts · 28d
Because I have eyes and have been consuming media for 50 years? LOL.
But seriously, find someone they say is questionable who is not, or someone they say is credible who is not. It's cool, I'll wait.
BrainInABox@lemmy.ml · 5 pts · 28d
How exactly does the biological fact that you have eyes and consume media allow you to determine whether a source is credible or not. And if that's true, well, we all have eyes and consume media, so what the fuck do we need some random dipshits personal opinion website for.
Multiple examples have already been provided in this very thread, including an outright Israeli propaganda site being marked as reliable.
Aren't you a middle aged man? Why do you still talk like an insufferable teenage loser?
davel@lemmy.ml · 3 pts · 28d
His development arrested at the self-centered, know-it-all stage; the cringiest stage.
jordanlund@lemmy.world · -4 pts · 28d
With experience comes wisdom. It's really quite simple. If you can't look at a source and go "Well, that has to be bullshit", you're going to have a bad time on the internet.
Sometimes I get surprised, rarely, it does happen.
The worst sites are the new ones that pop up with absolutely no history and appear to just be AI slop.
BrainInABox@lemmy.ml · 4 pts · 28d
So what the fuck do we need some random dipshits personal opinion website for?
Multiple examples have already been provided in this very thread, including an outright Israeli propaganda site being marked as reliable.
jordanlund@lemmy.world · -2 pts · 27d
Because not everyone is smart enough to recognize that Fox News is bullshit or that TASS is Russian propaganda.
Further, bad actors will insist "no it's not" to which moderators can simply reply:
whatiswrongwithyou@lemmy.ml · 6 pts · 29d
Lol
jordanlund@lemmy.world · -7 pts · 29d
whatiswrongwithyou@lemmy.ml · 7 pts · 29d
Lol
beliquititious@lemmy.blahaj.zone · 8 pts · 30d
Damn it, that sounds unsound enough that it's not even still useful for personal use. That's a shame. A more rigorous version of MB/FS would be genuinely useful when a major event happens to help filter out the nonsense.
JackbyDev@programming.dev · 5 pts · 29d
The thread has been enlightening. I don't think I've used MBFC in a while, but I thought the concerns were only that it used an American perspective for left/right instead of a global or true definition of it. (As in, Democrat left, Republican right. When in reality Democrats are a center-right party.) But I didn't realize these other things.
mrdown@lemmy.world · 1 pts · 30d