I work for a company that works for a company that works for a company.
We have clients that are clients of clients, and may be direct clients in some other aspect.
We host services for these entities.
That is all fine until they don't pay us.
When they don't pay us, there are multiple rounds of contacting someone who will contact someone who will contact someone. Someday.
Sometimes, someday does not arrive.
At that point, we conduct the Scream Test.
The essence of the Scream Test is:
- This thing is theoretically not needed.
- Let's turn it off.
- And see who screams?
We shut down some stuff today. Waiting on the cacophony...
19 Comments
DokPsy@lemmy.world · 57 pts · 5d
Love a good ol scream test. Only problem is you have to make sure to keep the disconnected thing or the data within for a solid year in case it's only used once annually by "very important process that makes sure the doors stay open" and no one realizes that thing you disconnected is where it's pulled from. Learned that one the hard way
dbtng@eviltoast.org · 28 pts · 5d
In this case, all we did was disable some ACLs. The machines are still running.
But ya. The point is to preserve whatever is actually needed. So don't nuke it before they can scream.
DokPsy@lemmy.world · 22 pts · 4d
But that urge to nuke it can really make some good arguments
dbtng@eviltoast.org · 23 pts · 4d
My boss designed a whole decomm system with wait periods and shit built into an app.
He still tells me, "You can just shut that down and delete it".
I don't. I make that jerk use his own system. "Put in a decomm, and I'll take care of it."
slazer2au@lemmy.world · 20 pts · 5d
With scream tests I unusually unplug the nic or whatever the equivalent is in a VM because a server can always have weird startup requirements that no one knows anymore while an unplugged nic doesn't change the running state if you need to bring it back online.
dbtng@eviltoast.org · 18 pts · 4d
We left that shit running and blocked it with ACLs on the switch.
The guests are kinda black-box stuff to us. Don't want to mess with em.
0x0@lemmy.dbzer0.com · 6 pts · 4d
What would you do if the power went out? Or you needed to upgrade the kernel?
slazer2au@lemmy.world · 10 pts · 4d
Everything was on a ups with enough run time to turn the genny on.
As for updates, that wasn't my problem.
tazeycrazy@feddit.uk · 2 pts · 4d
That's an unplanned power outage. A scream test would be a planed test. You also should do the email to all departments to see who knows what they are for and what you are doing. Usually gets the managers in a panic and those emails runs up and down the chains faster than "can you tell me what srv-15935 does"
Deconceptualist@leminal.space · 19 pts · 4d
This post feels like poetry.
pdxfed@lemmy.world · 10 pts · 5d
Is the official name for this "the scream test"?
I do this in lots of jobs; I tend to come in on cleanup jobs after gross incompetence, sometimes for many years. In addition to fixing problems, I have to help companies learn what should be happening and realign them to normal operating practices. Stopping pointless, worthless, outdated and redundant practices are something I do, and sometimes I apply the method above, though with many fewer degrees of separation than you have to those who may be affected. I find cutting pointless stuff to be one of the best ways to focus energy on things that do matter, get people to a better place and sometimes even save money doing it.
dbtng@eviltoast.org · 8 pts · 5d
Ya man. Google it. I'm not that creative. Did not make it up.
pdxfed@lemmy.world · 4 pts · 4d
Interesting, results seem to be focused in IT as a somewhat common approach but I'm not in IT, curious it has settled there in the vernacular.
Bashnagdul@lemmy.world · 4 pts · 3d
In Dutch its called the beep system. If something is shut down, we wait for the beeping to start, be it a different system or a person.
pdxfed@lemmy.world · 2 pts · 3d
5 points for approachable naming!
My self-hosted YouTube channel with flames on the intro and intense guitar riffs will go with the Murican "scream test" with a Scream-O-Meter.com site link; my NYT best seller for pragmatic business strategy will be dubbed "the beep test" and have soft cream and pastel coloring with a demure typeface and wine pairing list on the inside back cover.
dbtng@eviltoast.org · 1 pts · 2d
Dutch is not a serious language. Or so I hear ...
tpihkal@lemmy.world · 9 pts · 5d
Anxiously waiting for a follow up.
tazeycrazy@feddit.uk · 4 pts · 4d
That's what it's called. The mystery server that know one knows who set it up and don't know what it dose won't know what's hit them when I'm back in on Monday.
tquid@sh.itjust.works · 2 pts · 3d
Excuse me this is "audio diagnosis", sheesh