• Buelldozer@lemmy.today
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    3
    ·
    3 months ago

    You are claiming the MB/FC is “crap” and at least indirectly accusing it of bias or poor methodology. Since I have a subscription to Ground.News I’m able to see how MB/FCs assessments compare against other outlets doing the same job such as Ad Fontes, Wikipedia, and others and MB/FC seems to be reasonably consistent with their peers.

    So do you have any concrete examples of MB/FC getting it wrong or being wildly different than their peers?

    • TrippyFocus@lemmy.ml
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      edit-2
      3 months ago

      Wrote this over on the announcement post for this bot:

      Just looking over the methodology it’s clear that it has it’s own biases:

      American Bias

      The website itself says it’s distinctions of left and right are US based which is very skewed from the rest of the world. There should be a disclaimer or it shouldn’t be used in any world news communities.

      Centrist Bias

      The website follows the idea of “enlightened centrism” since if it determines a website has a left/right lean (again arbitrary) it affects the factual ratings of the sources.

      Examples of this are: FAIR only getting the 2nd highest rating despite never having failed a fact check.

      The Intercept getting only a “mostly factual” rating (3rd highest) despite their admittance it has never failed a fact check.

      Despite my personal opinions on the pointlessness of using a US based left/right bias criteria I’d feel better if it was at least kept it it’s own section but when you allow it to affect the factual rating of the source it’s just outright wrong. The factual accuracy of the website should be the sole thing that affects this rating.

      Questionable Fact Checking

      Even just checking some of their ratings raises doubts on the websites credibility.

      The ADL is rated as high (2nd highest) and wasn’t found to fail any fact checks.

      The ADL was found to be so unreliable on it’s reporting of the Israel-Palestine conflict it is considered an unreliable source by Wikipedia.

      “Wikipedia’s editors declared that the Anti-Defamation League cannot be trusted to give reliable information on the Israel-Palestine conflict, and they overwhelmingly said the ADL is an unreliable source on antisemitism.”

      Maybe Wikipedia editors are a good arbiter of truth and maybe they aren’t but as people can see there isn’t a consensus and so by choosing Media Bias/Fact Check you’re explicitly choosing to align your “truth” with this websites biases.

      • Buelldozer@lemmy.today
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        3 months ago

        American Bias

        Everywhere in the world is very skewed from the rest of the world. Someone in Venezuela would likely not agree with a bias rating given by someone in the UK and they likely wouldn’t agree with someone in India who would likely not agree with someone in China. What you’re basically saying, perhaps without realizing it, is that bias ratings shouldn’t be given at all.

        Centrist Bias

        I don’t know why FAIR is being rated as “High” instead of “Very High” by MB/FC but I don’t see this as some kind of overwhelming issue. The Intercept ranking has an explanation in the report and you should read it but it comes down to the fact that they’re known to only cover certain stories, they’re known to repress journalists, and they’ve been previously caught with writers that were making stuff up. Despite all of that they’re still being rated “mostly factual”, so again I’m not seeing this as an overwhelming issue.

        Questionable Fact Checking

        So the ADL is ranked the same as FAIR. Seems consistent. You’re also overstating the Wikipedia article, Wikipedia only considers them unreliable on the Palestinian Conflict. The ADL is still perfectly fine (with them) for other things.

        MB/FC does still rate ADL as “High” but it’s worth note that the Wikepedia re-date happened after MB/FC’s last review of the ADL. The next time that MB/FC re-rates the ADL it’s like to go down or get specific notes regarding the Palestinian Conflict.

        I thank you for taking the time to reply. I did look at and consider your argument and your sources but at the end I find them to be unpersuasive. There’s no sign of serious problems, how MB/FC evaluates sources is clearly stated and appears to be consistently applied. I will watch the ADL ranking to see what, if anything happens, but a single example of something that needs a re-rank on a specific issue doesn’t demonstrate a pattern. Finally there’s isn’t a single media bias checker on the planet that can be all things to all people at all times, it’s not possible, and since it’s not possible you really can’t knock them for not being up to a literally impossible standard.

        • TrippyFocus@lemmy.ml
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          3 months ago

          What you’re basically saying, perhaps without realizing it, is that bias ratings shouldn’t be given at all.

          What I’m saying is that on a world news community we shouldn’t be using a US based left/right. What that should be should be voted on by the community if the mods insist we need to have some sort of fact checker like this which I disagree is needed.

          I don’t know why FAIR is being rated as “High” instead of “Very High” by MB/FC but I don’t see this as some kind of overwhelming issue. The Intercept ranking has an explanation in the report and you should read it but it comes down to the fact that they’re known to only cover certain stories, they’re known to repress journalists, and they’ve been previously caught with writers that were making stuff up. Despite all of that they’re still being rated “mostly factual”, so again I’m not seeing this as an overwhelming issue.

          The reason FAIR doesn’t is because MB/FC downgrades sources if it (arbitrarily based on the US right skewed Overton window) decides a source is left/right bias even if there has never been a failed fact check. For The intercept it was literally 1 reporter and they retracted all bogus statements, I could see that being 2nd rating then.

          Again the 3 sources I mentioned we’re literally the first 3 I checked, it’s not a small issue with MB/FC it’s the fact that the methodolgy downgrades the factual rating if the source isn’t as centrist as the (effectively) 1 guy that runs the website wants the source to be. What number of incorrect ratings would make you decide this is a terrible checker? Cause with some time I’m sure I could come up with any reasonable target given.

          So the ADL is ranked the same as FAIR. Seems consistent. You’re also overstating the Wikipedia article, Wikipedia only considers them unreliable on the Palestinian Conflict. The ADL is still perfectly fine (with them) for other things.

          Didn’t overstate I specifically mentioned twice what it was basing that off of. Also I don’t see how that would be consistent when 1 source has never failed a fact check and the other has been deemed unreliable on both the Palestinian conflict and on anti-sentism. How should both of those be the same rating?

          There probably isn’t a fact checker out there that’s going to be perfect and also free but that doesn’t mean we shoehorn a crappy one in here without putting massive disclaimers clearly calling out the biases it has.

    • Beryl@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 months ago

      Both Ground News and Media Bias are tuned to a very US-centric vision of what is left or right, which means that thanks to this right biased Overton window, anything they classify as left would probably be considered center in Europe. Unfortunately, said window is also slinding to the right in Europe under the influence of European right leaders calling anything left of center “far-left”, see for example : Macron.

      • Buelldozer@lemmy.today
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 months ago

        Both Ground News and Media Bias are tuned to a very US-centric vision of what is left or right

        It’s a fair criticism but the idea that there’s some Media Bias organization out there that CAN do the job is false. Everywhere in the world is very skewed from the rest of the world. Someone in Venezuela would likely not agree with a bias rating given by someone in the UK and they likely wouldn’t agree with someone in India who would likely not agree with someone in China. What you’re basically saying, perhaps without realizing it, is that bias ratings shouldn’t be given at all.

        Unfortunately, said window is also slinding to the right in Europe under the influence of European right leaders calling anything left of center “far-left”, see for example : Macron.

        Excellent example. To an American Macron would be “Far Left”. To a Frenchie he’s “Center”. In China he’d likely be “Right or Far Right”.

        This highlight the problem. NO Media Bias organization could ever possibly hope to encompass all of that, so the best that’s possible is for the rating organization to clearly explain their viewpoint, methodology, and be consistent in their ratings. All of which I think MB/FC is doing acceptably well.