Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

NodeBB

  1. Home
  2. General Discussion
  3. With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts.

With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts.

Scheduled Pinned Locked Moved General Discussion
holosdiscovernobotnoindexactivitypub
30 Posts 18 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • apps@toot.fedilab.appA apps@toot.fedilab.app

    With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub.
    Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks.
    We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

    D This user is from outside of this forum
    D This user is from outside of this forum
    dummi@norden.social
    wrote last edited by
    #20

    @apps
    To be honest, I didn't understand any of what you wrote. Is there a page explaining the issue?

    1 Reply Last reply
    0
    • apps@toot.fedilab.appA apps@toot.fedilab.app

      With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts. Every deletion, edit or block was processed instantly via #ActivityPub.
      Google uses that same "indexable" flag but ignores everything else, keeps deleted content cached for weeks.
      We shut it down after pushback. Was that the right call? Don't hesitate to share, this concerns the whole Fediverse.

      finchhaven@sfba.socialF This user is from outside of this forum
      finchhaven@sfba.socialF This user is from outside of this forum
      finchhaven@sfba.social
      wrote last edited by
      #21

      @apps

      So this dead horse flinched again

      "With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts."

      I'll copy-pasta with only slight edits:

      My entire point (all the noise notwithstanding) focused on

      Default opt-in versus default opt-out

      This is an agent --> recipient transaction

      Default opt-in: the recipient is opted into (and receives) the agent's action whether the recipient --> knows of <-- the action or not

      Default opt-out: the recipient is opted out of (and cannot receive) the action whether the recipient --> knows of <-- the action or not

      Neither default opt-in nor default opt-out have any logical meaning if

      --> THE RECIPIENT DOES NOT KNOW OF THE AGENT <--

      in advance

      There was no mechanism for prior notification *before* indexing

      People would have had to stumble on what you're doing, by how, exactly?

      How dose the recipient learn of what you've done *before* you do it?

      shadowwwind@fosstodon.orgS 1 Reply Last reply
      0
      • finchhaven@sfba.socialF finchhaven@sfba.social

        @apps

        So this dead horse flinched again

        "With #HolosDiscover we checked multiple criteria before indexing: "indexable" enabled, account not locked, no #nobot or #noindex in bio, not in opted-out list, only public posts."

        I'll copy-pasta with only slight edits:

        My entire point (all the noise notwithstanding) focused on

        Default opt-in versus default opt-out

        This is an agent --> recipient transaction

        Default opt-in: the recipient is opted into (and receives) the agent's action whether the recipient --> knows of <-- the action or not

        Default opt-out: the recipient is opted out of (and cannot receive) the action whether the recipient --> knows of <-- the action or not

        Neither default opt-in nor default opt-out have any logical meaning if

        --> THE RECIPIENT DOES NOT KNOW OF THE AGENT <--

        in advance

        There was no mechanism for prior notification *before* indexing

        People would have had to stumble on what you're doing, by how, exactly?

        How dose the recipient learn of what you've done *before* you do it?

        shadowwwind@fosstodon.orgS This user is from outside of this forum
        shadowwwind@fosstodon.orgS This user is from outside of this forum
        shadowwwind@fosstodon.org
        wrote last edited by
        #22

        @FinchHaven @apps so you would like to be asked everytime a search engine wants to index your profile? That's like the cookie popups, I will just stop reading them at some point.

        finchhaven@sfba.socialF 1 Reply Last reply
        0
        • shadowwwind@fosstodon.orgS shadowwwind@fosstodon.org

          @FinchHaven @apps so you would like to be asked everytime a search engine wants to index your profile? That's like the cookie popups, I will just stop reading them at some point.

          finchhaven@sfba.socialF This user is from outside of this forum
          finchhaven@sfba.socialF This user is from outside of this forum
          finchhaven@sfba.social
          wrote last edited by
          #23

          @shadowwwind

          This is the old, worn out Fediverse "Well anybody can search the Internet any time they want to so why do you care?"

          Which 1) most people cannot, lacking the technical expertise, and 2) most people don't want to have happen to them anyway

          <snip>

          cc @apps

          shadowwwind@fosstodon.orgS 1 Reply Last reply
          0
          • finchhaven@sfba.socialF finchhaven@sfba.social

            @shadowwwind

            This is the old, worn out Fediverse "Well anybody can search the Internet any time they want to so why do you care?"

            Which 1) most people cannot, lacking the technical expertise, and 2) most people don't want to have happen to them anyway

            <snip>

            cc @apps

            shadowwwind@fosstodon.orgS This user is from outside of this forum
            shadowwwind@fosstodon.orgS This user is from outside of this forum
            shadowwwind@fosstodon.org
            wrote last edited by
            #24

            @FinchHaven @apps huh, that's not what I meant

            The way I understood you, is that opt-in and opt-out don't work because the user doesn't know what service wants to do what with their profile.
            Which to me sounded like you want to get a notification and decide manually everytime a service wants to index your profile. Did I get that wrong?

            finchhaven@sfba.socialF 1 Reply Last reply
            0
            • shadowwwind@fosstodon.orgS shadowwwind@fosstodon.org

              @FinchHaven @apps huh, that's not what I meant

              The way I understood you, is that opt-in and opt-out don't work because the user doesn't know what service wants to do what with their profile.
              Which to me sounded like you want to get a notification and decide manually everytime a service wants to index your profile. Did I get that wrong?

              finchhaven@sfba.socialF This user is from outside of this forum
              finchhaven@sfba.socialF This user is from outside of this forum
              finchhaven@sfba.social
              wrote last edited by
              #25

              @shadowwwind

              "The way I understood you, is that opt-in and opt-out don't work because the user doesn't know what service wants to do what with their profile."

              My point was, the user doesn't even *know* the service exists when they''ve been opted-in and weird stuff starts happening

              "Why are these people suddenly Liking and Boosting and Replying to my posts? I don't Follow them, they don't Follow me, they didn't use any hashtags I Follow and yet they're popping up in my Home Feed?"

              They're already *using* a service you've been opted in to, without your knowing you've been opted in because you had no clue the service existed until *after* weird stuff happens in your Home feed

              It's happened before

              Byron Miller (supernovae @ Universeodon) and his famous reply "Well, in the four months of having (our) full-text search we haven't heard from anyone who has suffered personal harm because of our search."

              That was good to know, anyway

              BTW the link to that quote 404s because Byron left for Bluesky

              cc @apps

              finchhaven@sfba.socialF 1 Reply Last reply
              0
              • finchhaven@sfba.socialF finchhaven@sfba.social

                @shadowwwind

                "The way I understood you, is that opt-in and opt-out don't work because the user doesn't know what service wants to do what with their profile."

                My point was, the user doesn't even *know* the service exists when they''ve been opted-in and weird stuff starts happening

                "Why are these people suddenly Liking and Boosting and Replying to my posts? I don't Follow them, they don't Follow me, they didn't use any hashtags I Follow and yet they're popping up in my Home Feed?"

                They're already *using* a service you've been opted in to, without your knowing you've been opted in because you had no clue the service existed until *after* weird stuff happens in your Home feed

                It's happened before

                Byron Miller (supernovae @ Universeodon) and his famous reply "Well, in the four months of having (our) full-text search we haven't heard from anyone who has suffered personal harm because of our search."

                That was good to know, anyway

                BTW the link to that quote 404s because Byron left for Bluesky

                cc @apps

                finchhaven@sfba.socialF This user is from outside of this forum
                finchhaven@sfba.socialF This user is from outside of this forum
                finchhaven@sfba.social
                wrote last edited by
                #26

                @shadowwwind

                "Which to me sounded like you want to get a notification and decide manually everytime a service wants to index your profile."

                No. That won't work if I don't know what the service is and that it exists in the first place

                The real point is that historically this has happened before, over the years, because people get opted-in to something they've never heard of, by default

                "Which to me sounded like you want to get a notification and decide manually everytime a service wants to index your profile."

                It's funny you mention this because Ryan "Bridgy" Barrett initially said he was going to send Mastodon people DMs which people (myself included) pointed out would not work, because most people have their DMs locked down

                Again, here: https://github.com/snarfed/bridgy-fed/issues/880#issue-2136207725

                cc @apps

                shadowwwind@fosstodon.orgS 1 Reply Last reply
                0
                • finchhaven@sfba.socialF finchhaven@sfba.social

                  @shadowwwind

                  "Which to me sounded like you want to get a notification and decide manually everytime a service wants to index your profile."

                  No. That won't work if I don't know what the service is and that it exists in the first place

                  The real point is that historically this has happened before, over the years, because people get opted-in to something they've never heard of, by default

                  "Which to me sounded like you want to get a notification and decide manually everytime a service wants to index your profile."

                  It's funny you mention this because Ryan "Bridgy" Barrett initially said he was going to send Mastodon people DMs which people (myself included) pointed out would not work, because most people have their DMs locked down

                  Again, here: https://github.com/snarfed/bridgy-fed/issues/880#issue-2136207725

                  cc @apps

                  shadowwwind@fosstodon.orgS This user is from outside of this forum
                  shadowwwind@fosstodon.orgS This user is from outside of this forum
                  shadowwwind@fosstodon.org
                  wrote last edited by
                  #27

                  @FinchHaven @apps yea my point is that notifications wouldn't work. How do you envision indexing to be properly done then?

                  "No. That won't work if I don't know what the service is and that it exists in the first place"
                  They way in understood you, explanations of the service would be part of the notifications.

                  1 Reply Last reply
                  0
                  • apps@toot.fedilab.appA apps@toot.fedilab.app

                    @lutindiscret
                    We panicked quickly because things escalated beyond what we expected. But we still believe our approach was far more respectful than what's already happening: the same data is being exploited by others without users even knowing. At worst, we raised awareness.

                    deutrino@mstdn.ioD This user is from outside of this forum
                    deutrino@mstdn.ioD This user is from outside of this forum
                    deutrino@mstdn.io
                    wrote last edited by
                    #28

                    @apps @lutindiscret yeah, always make sure to check whether the screeching is coming from A Certain Subset of terminally toxic M*st*d*n users when evaluating "public pressure"

                    personally, I'd just block the usual suspects instances which always start this type of shit and move on, they're increasingly isolated nowadays anyway and don't have anywhere near the clout they wish they did.

                    1 Reply Last reply
                    0
                    • lexinova@cyberplace.socialL lexinova@cyberplace.social

                      @apps the issue of #nobot #noindex, it's the fact it's opt-out

                      and people are fedup of opt out and want opt in

                      mattesilver@101010.plM This user is from outside of this forum
                      mattesilver@101010.plM This user is from outside of this forum
                      mattesilver@101010.pl
                      wrote last edited by
                      #29

                      @lexinova @apps

                      you opted-in by making your posts public

                      lexinova@cyberplace.socialL 1 Reply Last reply
                      0
                      • mattesilver@101010.plM mattesilver@101010.pl

                        @lexinova @apps

                        you opted-in by making your posts public

                        lexinova@cyberplace.socialL This user is from outside of this forum
                        lexinova@cyberplace.socialL This user is from outside of this forum
                        lexinova@cyberplace.social
                        wrote last edited by
                        #30

                        @mattesilver @apps for fediverse public != that allowing to be automatically taken for other app.

                        1 Reply Last reply
                        0
                        • tag-activitypub@relay.fedi.buzzT tag-activitypub@relay.fedi.buzz shared this topic

                        Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                        Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                        With your input, this post could be even better 💗

                        Register Login
                        Reply
                        • Reply as topic
                        Log in to reply
                        • Oldest to Newest
                        • Newest to Oldest
                        • Most Votes


                        • Login

                        • Don't have an account? Register

                        • Login or register to search.
                        Powered by NodeBB Contributors
                        • First post
                          Last post
                        0
                        • Categories
                        • Recent
                        • Tags
                        • Popular
                        • World
                        • Users
                        • Groups