Last9Last9

The origin of Service Level Objectives

An obscure term - Service Level Objectives - rules the Software industry. But where does it come from? Strap on your seat belts, this is going to be a bumpy one (pun intended :p)

Feb 21st, ‘22 | 4 min read

Share:

The origin of Service Level Objectives

📚 The year is 1984!

It’s been around ~80 years since Robert Frost met the two roads that diverged in the wood and took the less traveled one. Alas, no one talks about the story after - potholes everywhere!

Moral: Think before you take the road less travelled by and trust Google Maps!

The US Transportation Research Board has been contemplating publishing a Highway Capacity Manual 🛣️  to guide the numerous engineers and architects involved in building the humungous network of highways all across the United States 🇺🇸, as urbanization deeply kicks in.

However, they realize they have no objective standard to measure the performance of these highways. A lot of brainstorming led to two factors becoming crucial:

1. ASSET QUALITY INDEX: 💹  There should be an absolute measure of the performance, dependent on the quality of the material, engineering design, wear and tear of the road, etc.

💡
A factor that essentially talks about the quality of the asset AND acts as a floor of performance measurement

Because the asset quality (the highway in this case) is ever degrading and the maintenance cost is high, it is crucial to define the absolute critical threshold below which the road is deemed “degraded” and must be attended. Until then, all one needs to do is routinely check if the condition is above the critical threshold or not.

While many such indexes exist today, the most common is the universally recognized international roughness index - an index to define how smooth a ride is based on the quality of the road.

2. CUSTOMER HAPPINESS INDEX: 🙋🏻 Over and above the floor of asset performance, we also need to understand how a customer remains happy with the asset. In the case of the US highway manual, this led to factors such as average Traffic congestion, Average vehicle speed, the density of traffic, etc. We can also further complicate this by introducing seasonality factors such as peak hour timing etc.

101 south v/s 101 north during rush hours

Example of what the Level of Standard (LOS) looks for the traffic congestion variable:

LOS Rating Term
A Free flow, traffic flowing at complete mobility, 27 car lengths difference b/w two consecutive cars
B Reasonably free flow, 16 car lengths
C Stable/near free flow, 11 car lengths
D Approaching unstable flow, eight-car lengths
E Unstable flow, operating at capacity, six-car lengths
F Forced or breakdown flow
💡
TIL - what all do you need for a good road trip: 🎵, 🍽️🍔 , 👫 AND a 27 car length LOS highway!

These two indexes lead to a highly used term in the heavy asset management industry (roadways, infra, etc.) called LEVELS OF SERVICE.

Accordingly, this term is used to define the performance of any service provided by the builder (analogy getting close to our software world, hang tight!)


Fact time:

Did you know that a similar Levels of Service concept is used in the sewage management industry 💩 ?

  1. ASSET QUALITY: number of cracks per pipe 🧨
    (standardized for cross-section area, the thickness of the wall, the material of the pipe, etc.)
  2. CUSTOMER HAPPINESS INDEX: number of times the flush works 🚽
    ( ~1 failure per 6 months seems acceptable to me, but you do you)

How does this translate to Service Level Objectives (SLOs)?

The year is 2022!

The goal of using SLOs today remains the same for which the good, wise folks were using Levels of Service back in the days:

Measure performance objectively!

Accordingly, therefore, we should measure the performance of our services on two levers:

  1. Asset quality: factors that define the absolute measure of material involved are usually the underlying Infrastructure, regardless of the traffic it serves.
  2. Customer happiness index: factors that could define customer happiness (or business objectives given business is also a customer to the internal tech team). It is essential to understand that these factors will vary as per your business and customer demands. Still, they always need to be measured outside in - as the customer experiences it. This translates to - Monitor Services, Not Servers for those familiar with us! This leads to SLOs on factors as availability, latency, throughput etc.

Here is a quick cheat sheet on which variable to use for which kind of service:

Type of service👇🏽 Availability Latency Throughput Correctness TAT/Lag
Consumer-Facing
Stateful
Asynchronous
Operational

(Learn more: How do you measure SLOs)


Summary

When deciding which SLOs to set for which service, keep in mind only two fundamental questions, and we promise you will have a smooth ride 🚀 :

  1. Am I measuring the factors that define the underlying Infrastructure? (asset quality index)
  2. Am I measuring the characteristics that determine the happiness of my customers? (customer happiness index)

Learn more about SLOs here

SLOs eased
Since the start of COVID, 👟 Runkeeper reports a 62% spike globally in people heading out for a weekly run. This statistic put in context; there is a +47.3% (globally) increase in people running compared to last year. And every one of those runners has one objective, to Run more

Feb 21st, ‘22 | 4 min read

Share:

Related posts
Have a question?

Keep up with everything to do in the world of site reliability engineering, & updates around interesting stories from fighting for your 9s.

Last9 on DiscordJoin our Discord ↗
SOC2 Type II Certified

Last9 cares deeply about its customer’s data and is SOC2 Type II certified. Please contact us at hello@last9.io for the report.

Last9 is SOC2 compliant
Last9 on DiscordLast9 on LinkedInLast9 on TwitterLast9 on Youtube
© 2023 Last9. All rights reserved.