https://kernels.rudrite.com/ https://kernels.rudrite.com/routes https://kernels.rudrite.com/workshop https://kernels.rudrite.com/bench https://kernels.rudrite.com/specimen https://kernels.rudrite.com/gym https://kernels.rudrite.com/gym/kernels https://kernels.rudrite.com/gym/jax https://kernels.rudrite.com/gym/xla https://kernels.rudrite.com/gym/pytorch https://kernels.rudrite.com/mistakes https://kernels.rudrite.com/mistakes/kernels https://kernels.rudrite.com/mistakes/jax https://kernels.rudrite.com/mistakes/xla https://kernels.rudrite.com/mistakes/pytorch https://kernels.rudrite.com/jax https://kernels.rudrite.com/xla https://kernels.rudrite.com/pytorch https://kernels.rudrite.com/l/source https://kernels.rudrite.com/l/jaxpr https://kernels.rudrite.com/l/stablehlo https://kernels.rudrite.com/l/xla https://kernels.rudrite.com/l/gap https://kernels.rudrite.com/l/pallas https://kernels.rudrite.com/l/mosaic https://kernels.rudrite.com/l/tpu https://kernels.rudrite.com/l/ici https://kernels.rudrite.com/s/machine https://kernels.rudrite.com/s/pallas https://kernels.rudrite.com/s/ir https://kernels.rudrite.com/s/kernels https://kernels.rudrite.com/s/distributed https://kernels.rudrite.com/s/capstone https://kernels.rudrite.com/jax/arrays https://kernels.rudrite.com/jax/tracing https://kernels.rudrite.com/jax/jit https://kernels.rudrite.com/jax/autodiff https://kernels.rudrite.com/jax/vmap https://kernels.rudrite.com/jax/control-flow https://kernels.rudrite.com/jax/pytrees https://kernels.rudrite.com/jax/random https://kernels.rudrite.com/jax/state https://kernels.rudrite.com/jax/sharding https://kernels.rudrite.com/jax/performance https://kernels.rudrite.com/jax/training-run https://kernels.rudrite.com/xla/pjrt https://kernels.rudrite.com/xla/ingestion https://kernels.rudrite.com/xla/hlo https://kernels.rudrite.com/xla/pipeline https://kernels.rudrite.com/xla/fusion https://kernels.rudrite.com/xla/layout-memory https://kernels.rudrite.com/xla/spmd https://kernels.rudrite.com/xla/collectives https://kernels.rudrite.com/xla/codegen https://kernels.rudrite.com/xla/autotuning https://kernels.rudrite.com/xla/ifrt https://kernels.rudrite.com/xla/mcjax https://kernels.rudrite.com/xla/pathways https://kernels.rudrite.com/xla/interfaces https://kernels.rudrite.com/xla/capstone https://kernels.rudrite.com/pytorch/tensors https://kernels.rudrite.com/pytorch/autograd https://kernels.rudrite.com/pytorch/modules https://kernels.rudrite.com/pytorch/the-loop https://kernels.rudrite.com/pytorch/data https://kernels.rudrite.com/pytorch/dynamo https://kernels.rudrite.com/pytorch/graphs https://kernels.rudrite.com/pytorch/distributed https://kernels.rudrite.com/pytorch/performance https://kernels.rudrite.com/pytorch/bridges https://kernels.rudrite.com/pytorch/tpu-practice https://kernels.rudrite.com/pytorch/training-run https://kernels.rudrite.com/l/source/what-tracing-takes https://kernels.rudrite.com/l/source/inside-the-tracer https://kernels.rudrite.com/l/jaxpr/the-anatomy https://kernels.rudrite.com/l/jaxpr/transforms-rewrite https://kernels.rudrite.com/l/jaxpr/nested-jaxprs https://kernels.rudrite.com/l/jaxpr/params-and-drills https://kernels.rudrite.com/l/jaxpr/one-name-one-definition https://kernels.rudrite.com/l/stablehlo/the-type-system https://kernels.rudrite.com/l/stablehlo/control-flow-is-regions https://kernels.rudrite.com/l/stablehlo/the-escape-hatch https://kernels.rudrite.com/l/stablehlo/why-stable https://kernels.rudrite.com/l/stablehlo/the-hlo-family https://kernels.rudrite.com/l/xla/two-dumps-two-truths https://kernels.rudrite.com/l/xla/the-fusion-taxonomy https://kernels.rudrite.com/l/xla/layouts https://kernels.rudrite.com/l/xla/the-memory-report https://kernels.rudrite.com/l/xla/dumps-on-demand https://kernels.rudrite.com/l/xla/the-one-level-world https://kernels.rudrite.com/l/xla/levels-as-a-first-class-idea https://kernels.rudrite.com/l/tpu/tpu-chip https://kernels.rudrite.com/l/tpu/generations https://kernels.rudrite.com/l/tpu/tensorcore-complex https://kernels.rudrite.com/l/tpu/sparsecore https://kernels.rudrite.com/l/tpu/two-ways-to-hide-latency https://kernels.rudrite.com/l/tpu/xprof-and-the-three-accounts https://kernels.rudrite.com/l/tpu/the-timeline-op-by-op https://kernels.rudrite.com/l/tpu/reading-it-like-an-operator https://kernels.rudrite.com/l/tpu/vliw-bundles-and-llo https://kernels.rudrite.com/l/ici/tpu-fabric https://kernels.rudrite.com/l/ici/the-vocabulary-as-ring-movements https://kernels.rudrite.com/l/ici/cost-formulas-in-your-head https://kernels.rudrite.com/l/ici/the-collective-is-a-kernel https://kernels.rudrite.com/l/ici/gpu-fabric https://kernels.rudrite.com/l/ici/the-optical-patch-panel https://kernels.rudrite.com/s/machine/die-and-reticle https://kernels.rudrite.com/s/machine/gpu-chip https://kernels.rudrite.com/s/machine/inside-the-sm https://kernels.rudrite.com/s/machine/two-machines https://kernels.rudrite.com/s/machine/the-isa-contract https://kernels.rudrite.com/s/machine/who-schedules https://kernels.rudrite.com/s/machine/scale-up https://kernels.rudrite.com/l/pallas/why-a-kernel-language https://kernels.rudrite.com/l/pallas/memory-spaces-and-scratch https://kernels.rudrite.com/l/pallas/refs https://kernels.rudrite.com/l/pallas/manual-dma https://kernels.rudrite.com/l/pallas/aliasing-and-debugging https://kernels.rudrite.com/l/pallas/one-language-three-backends https://kernels.rudrite.com/s/pallas/blockspec https://kernels.rudrite.com/s/pallas/grid-and-pipeline https://kernels.rudrite.com/s/pallas/scalar-world https://kernels.rudrite.com/l/mosaic/to-machine-code https://kernels.rudrite.com/l/mosaic/the-tiling-vocabulary https://kernels.rudrite.com/l/mosaic/reading-layout-decisions https://kernels.rudrite.com/xla/pjrt/pjrt-boundary https://kernels.rudrite.com/xla/hlo/hlo-invariants https://kernels.rudrite.com/xla/pipeline/pass-pipeline https://kernels.rudrite.com/xla/fusion/reading-fusion https://kernels.rudrite.com/xla/spmd/the-partitioner https://kernels.rudrite.com/xla/codegen/backend-seam https://kernels.rudrite.com/xla/codegen/triton-end-to-end https://kernels.rudrite.com/xla/ifrt/above-the-compiler https://kernels.rudrite.com/xla/ingestion/the-translation-walk https://kernels.rudrite.com/xla/layout-memory/copies-and-buffers https://kernels.rudrite.com/xla/collectives/six-shardings-one-matmul https://kernels.rudrite.com/xla/autotuning/reading-the-autotune-cache https://kernels.rudrite.com/xla/mcjax/the-coordination-handshake https://kernels.rudrite.com/jax/arrays/three-classes-one-check https://kernels.rudrite.com/jax/arrays/the-weak-ones-adapt https://kernels.rudrite.com/jax/arrays/what-blocking-waits-on https://kernels.rudrite.com/jax/tracing/shape-dtype-and-no-numbers https://kernels.rudrite.com/jax/tracing/what-a-tracer-refuses https://kernels.rudrite.com/jax/tracing/frozen-passed-or-escaped https://kernels.rudrite.com/jax/jit/two-counters https://kernels.rudrite.com/jax/jit/the-price-of-static https://kernels.rudrite.com/jax/jit/before-the-first-call https://kernels.rudrite.com/jax/autodiff/the-rule-under-grad https://kernels.rudrite.com/jax/autodiff/which-direction-costs-what https://kernels.rudrite.com/jax/autodiff/when-you-write-the-rule https://kernels.rudrite.com/jax/autodiff/stopping-and-stacking https://kernels.rudrite.com/jax/vmap/the-rule-per-primitive https://kernels.rudrite.com/jax/vmap/where-the-axis-goes https://kernels.rudrite.com/jax/vmap/composed-with-grad-and-jit https://kernels.rudrite.com/jax/control-flow/both-branches-one-index https://kernels.rudrite.com/jax/control-flow/the-carry-is-a-type https://kernels.rudrite.com/jax/control-flow/one-trace-however-many-steps https://kernels.rudrite.com/jax/pytrees/flatten-happens-first https://kernels.rudrite.com/jax/pytrees/structure-then-leaves https://kernels.rudrite.com/jax/pytrees/nodes-you-register https://kernels.rudrite.com/jax/random/two-words-and-a-hash https://kernels.rudrite.com/jax/random/reuse-is-silent https://kernels.rudrite.com/jax/random/keys-through-vmap-and-scan https://kernels.rudrite.com/jax/state/the-step-returns-its-state https://kernels.rudrite.com/jax/state/donating-the-state-tree https://kernels.rudrite.com/jax/state/a-state-that-earns-its-shape https://kernels.rudrite.com/jax/sharding/mesh-and-spec https://kernels.rudrite.com/jax/sharding/placing-an-array https://kernels.rudrite.com/jax/sharding/jit-partitions https://kernels.rudrite.com/jax/sharding/pinning-a-layout https://kernels.rudrite.com/jax/performance/what-the-clock-caught https://kernels.rudrite.com/jax/performance/what-the-process-holds https://kernels.rudrite.com/jax/performance/residuals-you-refuse-to-keep https://kernels.rudrite.com/jax/training-run/one-tree-in-one-tree-out https://kernels.rudrite.com/jax/training-run/three-shapes-of-loop https://kernels.rudrite.com/jax/training-run/kill-it-and-prove-it https://kernels.rudrite.com/pytorch/tensors/two-objects-one-tensor https://kernels.rudrite.com/pytorch/tensors/the-address-arithmetic https://kernels.rudrite.com/pytorch/tensors/when-a-view-refuses https://kernels.rudrite.com/pytorch/tensors/two-layouts-one-shape https://kernels.rudrite.com/pytorch/autograd/the-node-behind-grad-fn https://kernels.rudrite.com/pytorch/autograd/who-owns-grad https://kernels.rudrite.com/pytorch/autograd/what-the-tape-kept https://kernels.rudrite.com/pytorch/autograd/a-backward-you-can-defend https://kernels.rudrite.com/pytorch/modules/what-the-object-holds https://kernels.rudrite.com/pytorch/modules/the-round-trip https://kernels.rudrite.com/pytorch/modules/what-a-move-does https://kernels.rudrite.com/pytorch/the-loop/what-the-optimizer-holds https://kernels.rudrite.com/pytorch/the-loop/between-backward-and-step https://kernels.rudrite.com/pytorch/the-loop/the-resume-that-matches https://kernels.rudrite.com/pytorch/data/one-index-at-a-time https://kernels.rudrite.com/pytorch/data/what-actually-forks https://kernels.rudrite.com/pytorch/data/same-order-different-numbers https://kernels.rudrite.com/pytorch/dynamo/the-frame-it-rewrites https://kernels.rudrite.com/pytorch/dynamo/what-a-guard-checks https://kernels.rudrite.com/pytorch/dynamo/anatomy-of-a-break https://kernels.rudrite.com/pytorch/dynamo/the-cache-line https://kernels.rudrite.com/pytorch/graphs/one-call-three-graphs https://kernels.rudrite.com/pytorch/graphs/reading-a-real-graph https://kernels.rudrite.com/pytorch/graphs/aten-core-aten-prims https://kernels.rudrite.com/pytorch/graphs/what-export-refuses https://kernels.rudrite.com/pytorch/distributed/one-world-four-processes https://kernels.rudrite.com/pytorch/distributed/buckets-and-the-reducer https://kernels.rudrite.com/pytorch/distributed/the-unit-you-wrapped https://kernels.rudrite.com/pytorch/distributed/mesh-and-dtensor https://kernels.rudrite.com/pytorch/performance/four-numbers-one-call https://kernels.rudrite.com/pytorch/performance/reading-one-real-trace https://kernels.rudrite.com/pytorch/performance/instruments-that-answer-nothing-here https://kernels.rudrite.com/pytorch/bridges/inside-the-lazy-tensor https://kernels.rudrite.com/pytorch/bridges/where-the-graph-gets-cut https://kernels.rudrite.com/pytorch/bridges/three-modes-one-machine https://kernels.rudrite.com/pytorch/bridges/the-seam https://kernels.rudrite.com/pytorch/bridges/what-survives https://kernels.rudrite.com/pytorch/tpu-practice/marking-a-sharding https://kernels.rudrite.com/pytorch/tpu-practice/reading-a-tpu-profile https://kernels.rudrite.com/pytorch/tpu-practice/calling-a-pallas-kernel https://kernels.rudrite.com/pytorch/training-run/the-checkpoint-is-a-file https://kernels.rudrite.com/pytorch/training-run/how-long-a-mistake-stays-quiet https://kernels.rudrite.com/pytorch/training-run/when-the-machine-takes-it-back