Research

Technical research with an operator’s bias toward evidence.

This section is for structured investigation—not hot takes. The goal is to separate observation, testing, interpretation, and conclusion so ideas can mature without pretending uncertainty does not exist.

From a research question to an operational decision.

Question

How consistent is model behavior across repeated observations, providers, and time? What changes when a prompt, model, or configuration changes?

Experiment and evidence

The experiment uses six providers, scheduled checkpoints, and short-window repeats. The public reference demonstrates provider abstraction, immutable run records, prompt/schema versions, provenance, validation, and separate evaluation.

Inspect the reference →

Operational implication

The working hypothesis: validation should continue after adoption. Evidence of material behavior changes should trigger review of the affected use case, prompt, controls, and approval boundaries.

Connect evidence to governance →

48 responses. Six providers. An initial cohort.

The dated report records 34 completed evaluations, two evaluations requiring human review, and zero recorded human reviews. It is an execution metadata baseline, not an adjudicated benchmark. One prompt does not establish general provider rankings or longitudinal drift.

Read the baseline and its limits →

The public repository runs a mock-provider example. The separate live experiment supplies dated observations; the repository itself is not evidence that six live integrations have been exercised.

A simple discipline: define the question, preserve the evidence, and make the assumptions visible.

1. Question

Start with a specific technical or operational question instead of a predetermined conclusion.

2. Method

Document the environment, test conditions, data sources, assumptions, controls, and limitations.

3. Evidence

Preserve observations, outputs, logs, measurements, version information, and enough context to revisit the result later.

4. Interpretation

Separate what was observed from what is inferred, and note where stronger evidence would change the conclusion.

Longitudinal Model Behavior

How model outputs change across providers, repeated samples, prompt versions, model revisions, and time.

Current work: provider normalization, provenance, evaluator separation, structured output validation, cost and token accounting.

Open reference implementation →

Reliable AI-Enabled Workflows

What changes when LLMs move from ad hoc assistance into repeatable operational workflows with approvals, auditability, failure recovery, and measurable service behavior.

Focus: human-in-the-loop controls, evidence capture, retries, idempotency, observability, governance.

Related platform case study →

Operational Reliability in Distributed Environments

How documentation quality, escalation inputs, standardization, identity, observability, and automation affect service reliability across many locations.

Focus: recurring failure patterns, deployment variance, support-system design, operational handoff.

Related case study →

Resilient Connected Systems

How edge systems behave under imperfect connectivity, noisy radio observations, power interruption, intermittent backhaul, and field-support constraints.

Focus: BLE/RFID/NFC, deduplication, buffering, store-and-forward, device identity, connectivity failover.

Open reference architecture →

Identity as an Operational Control Plane

How lifecycle automation, privileged access, Conditional Access, emergency access, workload identity governance, and auditability shape enterprise risk.

Focus: Entra ID, RBAC, PIM concepts, least privilege, workload identities, identity incident response.

Open reference architecture →

Email Authentication and Domain Posture

How SPF, DKIM, DMARC, MX configuration, transport security, and DNS design contribute to practical email security posture.

Focus: passive assessment, evidence-based findings, remediation guidance, false confidence from partial controls.

Open security tool →

Exploration is allowed to be incomplete. Claims are not.

Research notes on this site will identify whether something is a hypothesis, observation, working interpretation, or supported conclusion. Where results depend on a specific model version, configuration, environment, data set, or test window, that context should travel with the result.

I am less interested in being first to a conclusion than in being able to explain why I reached it—and what would make me revise it.

Three layers, depending on maturity.

Research Notes

Early observations, test designs, questions, unexpected results, and methodological decisions. Useful but explicitly provisional.

Technical Briefs

More structured findings with methodology, evidence, limitations, interpretation, and practical implications.

Reference Implementations

Public code or architecture showing how a finding, pattern, or operating principle can be translated into a working system.

Curiosity without leaking somebody else’s system.

Research published here is based on public information, personal experimentation, sanitized reference architectures, and generalized technical patterns. Employer, customer, tenant, credential, device, and proprietary data stay out of the public research layer.

Follow the evidence across repeated observations.

The Glowing Oracle’s six-provider experiment is active. Dated reports preserve observed data, review status, limits, and operational implications, with a new report every 30 days.