Autoconfig Independent coverage of news

Understanding News Fundamentals 5: Costs, Limits and Trade-offs

By David Kim · · 1234 words
Understanding News Fundamentals 5: Costs, Limits and Trade-offs

Consider content delivery specifically. The interesting number is not the average, it is the 99th percentile. Content Delivery: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. That applies to content delivery as well.

Monitoring Alerts: Serving static bytes is the cheapest thing you can do at the edge. Monitoring Alerts: A schema is an interface; changing it is a migration, not an edit. Monitoring Alerts: Track the denominator as carefully as the numerator.

Before raising the subject, consider what matters to you. A boundary might concern whether you want a particular kind of sexual contact, when you feel ready, what privacy means to you, or what safer-sex measures you expect. It can also be a condition: for example, you may want to discuss contraception or STI testing before sexual activity. You do not need to have a complete list or a perfectly polished explanation. Start with the limit that feels most relevant now.

Data Pipelines: The interesting number is not the average, it is the 99th percentile. Data Pipelines: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Data Pipelines: Every abstraction you add is a place where behaviour can differ from intent.

Teams working on log analysis usually discover this the hard way. Serving static bytes is the cheapest thing you can do at the edge. A schema is an interface; changing it is a migration, not an edit. This is most visible in log analysis. Consider log analysis specifically. Track the denominator as carefully as the numerator.

Consider search indexing specifically. If the rollback plan needs a meeting, it is not a rollback plan. Search Indexing: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. That applies to search indexing as well.

Teams working on api design usually discover this the hard way. Serving static bytes is the cheapest thing you can do at the edge. A schema is an interface; changing it is a migration, not an edit. This is most visible in api design. Consider api design specifically. Track the denominator as carefully as the numerator.

Do not treat a relationship, previous sexual activity, clothing, flirting or a past agreement as permission now. Consent is about a person’s choice in the present. If the answer is no, unclear or hesitant, pause. You do not need a reason to respect a boundary, and the other person does not have to justify it.

Edge Caching: If the rollback plan needs a meeting, it is not a rollback plan. Edge Caching: Small pages that stay small are easier to keep fast than large ones made fast. Edge Caching: Write the invariant down; otherwise it lives only in someone's memory.

API Design: If a metric has no owner, it will drift until it causes an incident. The cheapest optimisation is usually removing work nobody asked for. That applies to api design as well. In practice, api design behaves differently: Aggregating at write time trades flexibility for predictable read cost.

For access control, the constraint matters more than the feature list. The first thing to settle is the failure mode, not the happy path. Teams working on access control usually discover this the hard way. Measurements taken once are anecdotes; you need a baseline that repeats. Costs usually concentrate in a small number of operations, so find those first. This is most visible in access control.

Schema Markup: If a metric has no owner, it will drift until it causes an incident. Schema Markup: The cheapest optimisation is usually removing work nobody asked for. Schema Markup: Aggregating at write time trades flexibility for predictable read cost.

Rate Limiting: Periodic jobs should be safe to run twice, because they will be. Rate Limiting: You rarely need a new component to fix a boundary problem. Rate Limiting: The signal you want is often already logged, just not aggregated.

The interesting number is not the average, it is the 99th percentile. The same reasoning holds for crawl budget. For crawl budget, the constraint matters more than the feature list. Adding a cache in front of a slow query is a fix; fixing the query is a cure. Teams working on crawl budget usually discover this the hard way. Every abstraction you add is a place where behaviour can differ from intent.

Consider data pipelines specifically. You can often replace a coordination problem with an idempotency key. Data Pipelines: Anything that grows without a bound will eventually hit one. Documentation that is not tested tends to describe the previous version. That applies to data pipelines as well.

Serving static bytes is the cheapest thing you can do at the edge. The same reasoning holds for monitoring alerts. For monitoring alerts, the constraint matters more than the feature list. A schema is an interface; changing it is a migration, not an edit. Teams working on monitoring alerts usually discover this the hard way. Track the denominator as carefully as the numerator.

Cost Controls: If a metric has no owner, it will drift until it causes an incident. Cost Controls: The cheapest optimisation is usually removing work nobody asked for. Cost Controls: Aggregating at write time trades flexibility for predictable read cost.

Begin by asking what the other person is comfortable with, rather than treating consent as a general approval of everything that might happen. Agreement to one activity does not automatically mean agreement to another. A person may also be comfortable with something one day and not another time.

In practice, release process behaves differently: The first thing to settle is the failure mode, not the happy path. Measurements taken once are anecdotes; you need a baseline that repeats. The same reasoning holds for release process. For release process, the constraint matters more than the feature list. Costs usually concentrate in a small number of operations, so find those first.

Schema Markup: Serving static bytes is the cheapest thing you can do at the edge. Schema Markup: A schema is an interface; changing it is a migration, not an edit. Schema Markup: Track the denominator as carefully as the numerator.

A queue smooths spikes but also hides how far behind you are. This is most visible in api design. Consider api design specifically. Retries without jitter turn a small outage into a large one. API Design: Separating the reads from the writes buys room to change either side.

Data Pipelines: Configurations should be reviewable in a diff, not only in a console. The best time to add an index is before the table gets large. That applies to data pipelines as well. In practice, data pipelines behaves differently: Failures are usually correlated, so plan for the shared dependency.

Edge Caching: Serving static bytes is the cheapest thing you can do at the edge. Edge Caching: A schema is an interface; changing it is a migration, not an edit. Edge Caching: Track the denominator as carefully as the numerator.

Cost Controls: The first thing to settle is the failure mode, not the happy path. Cost Controls: Measurements taken once are anecdotes; you need a baseline that repeats. Cost Controls: Costs usually concentrate in a small number of operations, so find those first.

Related reading