Shortcuts

Introduction to torch.compile

Created On: Mar 15, 2023 | Last Updated: Aug 30, 2024 | Last Verified: Nov 05, 2024

Author: William Wen

torch.compile is the latest method to speed up your PyTorch code! torch.compile makes PyTorch code run faster by JIT-compiling PyTorch code into optimized kernels, all while requiring minimal code changes.

In this tutorial, we cover basic torch.compile usage, and demonstrate the advantages of torch.compile over previous PyTorch compiler solutions, such as TorchScript and FX Tracing.

Contents

Required pip Dependencies

  • torch >= 2.0

  • torchvision

  • numpy

  • scipy

  • tabulate

NOTE: a modern NVIDIA GPU (H100, A100, or V100) is recommended for this tutorial in order to reproduce the speedup numbers shown below and documented elsewhere.

import torch
import warnings

gpu_ok = False
if torch.cuda.is_available():
    device_cap = torch.cuda.get_device_capability()
    if device_cap in ((7, 0), (8, 0), (9, 0)):
        gpu_ok = True

if not gpu_ok:
    warnings.warn(
        "GPU is not NVIDIA V100, A100, or H100. Speedup numbers may be lower "
        "than expected."
    )
/var/lib/workspace/intermediate_source/torch_compile_tutorial.py:48: UserWarning:

GPU is not NVIDIA V100, A100, or H100. Speedup numbers may be lower than expected.

Basic Usage

torch.compile is included in the latest PyTorch. Running TorchInductor on GPU requires Triton, which is included with the PyTorch 2.0 nightly binary. If Triton is still missing, try installing torchtriton via pip (pip install torchtriton --extra-index-url "https://download.pytorch.org/whl/nightly/cu117" for CUDA 11.7).

Arbitrary Python functions can be optimized by passing the callable to torch.compile. We can then call the returned optimized function in place of the original function.

def foo(x, y):
    a = torch.sin(x)
    b = torch.cos(y)
    return a + b
opt_foo1 = torch.compile(foo)
print(opt_foo1(torch.randn(10, 10), torch.randn(10, 10)))
/usr/local/lib/python3.10/dist-packages/onnxscript/converter.py:820: FutureWarning:

'onnxscript.values.Op.param_schemas' is deprecated in version 0.1 and will be removed in the future. Please use '.op_signature' instead.

/usr/local/lib/python3.10/dist-packages/onnxscript/converter.py:820: FutureWarning:

'onnxscript.values.OnnxFunction.param_schemas' is deprecated in version 0.1 and will be removed in the future. Please use '.op_signature' instead.

tensor([[ 1.6850,  1.9924,  1.7090,  0.0034,  1.1414, -0.1822,  0.4861, -0.0536,
         -0.2252,  1.9398],
        [ 0.3693, -0.0695,  0.1748,  0.3436,  0.1939,  1.5721,  1.9882, -0.2235,
          0.3161,  1.2642],
        [ 0.2480,  1.8793,  1.7152,  1.6772,  1.8881,  1.4748,  1.3466,  1.7763,
          0.7469,  1.0407],
        [-0.1121,  1.6015, -0.0188,  0.2128,  0.5218,  1.9838,  0.8185,  0.5093,
         -0.3603,  0.1793],
        [-1.7890,  1.7532, -0.4040,  0.1222, -0.0029,  1.7975, -0.3877,  0.5123,
          0.1673,  0.1330],
        [ 1.0627,  0.9609,  0.1019,  1.8814,  0.1142, -0.2338, -0.9621,  0.7631,
          0.6506,  0.1853],
        [ 0.4584,  1.7648, -0.0444,  1.9610,  1.5884,  0.7353,  1.2190,  1.3662,
          1.0938, -0.1587],
        [-0.7502,  1.6640,  0.3495,  1.3496,  0.8187,  1.1719,  0.5820,  0.1498,
          0.0885,  0.1036],
        [ 0.3961,  0.6043, -0.0861, -0.3371,  0.8622,  1.4341,  1.2988,  0.5023,
          0.3074,  0.1277],
        [ 0.9748,  0.4117,  1.2616,  1.6314,  0.4693,  0.4092,  0.0401,  1.1196,
          1.2458,  1.3280]])

Alternatively, we can decorate the function.

t1 = torch.randn(10, 10)
t2 = torch.randn(10, 10)

@torch.compile
def opt_foo2(x, y):
    a = torch.sin(x)
    b = torch.cos(y)
    return a + b
print(opt_foo2(t1, t2))
tensor([[ 0.5360,  0.1697, -0.0561,  0.1890, -0.1310,  1.2276,  1.1739,  0.1944,
         -0.1561,  1.6990],
        [ 1.0421,  1.9472,  0.2682,  0.2701,  1.3346,  0.7651,  1.0897,  1.1730,
          0.6161,  0.9223],
        [ 1.5756,  1.5294,  0.0112, -0.1522, -0.7674,  1.8515, -0.2443,  0.3696,
          0.2693,  0.8735],
        [-0.3701,  1.1190,  1.4164,  1.8648,  1.2080,  0.0732,  1.5274,  0.6868,
          1.2440,  1.0715],
        [-1.2454, -0.0159,  0.4315,  0.1317,  1.0530, -1.0603, -0.0532,  0.6661,
          1.7101, -0.2076],
        [-0.7091,  0.7824,  1.7161,  1.2750,  0.6368,  1.2488,  0.4897,  1.2429,
          1.3409,  1.3735],
        [ 0.8345,  0.0653,  0.3462,  1.2383, -0.4092,  1.6438, -0.0962,  0.4011,
          0.2463, -0.5802],
        [ 1.6349,  0.7297,  1.2547, -0.3113,  0.9310,  0.1162,  1.7618,  0.4882,
          0.7640,  0.2930],
        [ 1.1669, -0.7775,  1.2000,  0.6008, -0.2814,  0.5541,  0.5753,  1.4731,
          1.6835,  0.7370],
        [ 1.5087,  0.6195,  0.1153,  1.2966,  1.8815,  1.1678,  1.5686,  1.6018,
          0.2193,  1.3500]])

We can also optimize torch.nn.Module instances.

t = torch.randn(10, 100)

class MyModule(torch.nn.Module):
    def __init__(self):
        super().__init__()
        self.lin = torch.nn.Linear(100, 10)

    def forward(self, x):
        return torch.nn.functional.relu(self.lin(x))

mod = MyModule()
opt_mod = torch.compile(mod)
print(opt_mod(t))
tensor([[0.0000, 0.7610, 0.2562, 0.0405, 0.0000, 0.3631, 0.3325, 0.0000, 0.4574,
         0.8850],
        [0.4322, 0.0984, 0.3238, 0.0000, 0.0000, 0.0000, 0.0000, 0.0000, 1.0738,
         0.1925],
        [0.0413, 0.1075, 0.0000, 0.0000, 0.2039, 0.0000, 1.7316, 0.0000, 0.0000,
         0.5836],
        [0.2436, 0.0000, 0.9565, 0.0000, 0.9550, 0.6644, 0.0000, 0.0000, 0.7600,
         0.0000],
        [0.0000, 0.3446, 0.0000, 0.5052, 1.1132, 0.0233, 0.0000, 0.1331, 0.5702,
         1.9597],
        [0.5364, 0.9321, 0.4773, 0.0000, 0.0000, 0.5301, 0.0000, 0.2444, 0.2557,
         0.0000],
        [0.0000, 0.0000, 0.8326, 0.0000, 0.5457, 0.0885, 0.0000, 1.1365, 0.0000,
         0.1474],
        [0.7596, 0.0000, 0.0000, 0.6814, 0.0000, 0.0000, 0.0000, 0.2448, 0.4532,
         0.0000],
        [0.0000, 0.0000, 0.0000, 0.0000, 0.5201, 0.0000, 0.6107, 0.3494, 0.2592,
         0.6562],
        [0.5368, 0.8832, 0.6859, 0.0000, 0.0000, 0.4080, 0.0000, 0.0000, 0.0000,
         0.0000]], grad_fn=<CompiledFunctionBackward>)

torch.compile and Nested Calls

Nested function calls within the decorated function will also be compiled.

def nested_function(x):
    return torch.sin(x)

@torch.compile
def outer_function(x, y):
    a = nested_function(x)
    b = torch.cos(y)
    return a + b

print(outer_function(t1, t2))
tensor([[ 0.5360,  0.1697, -0.0561,  0.1890, -0.1310,  1.2276,  1.1739,  0.1944,
         -0.1561,  1.6990],
        [ 1.0421,  1.9472,  0.2682,  0.2701,  1.3346,  0.7651,  1.0897,  1.1730,
          0.6161,  0.9223],
        [ 1.5756,  1.5294,  0.0112, -0.1522, -0.7674,  1.8515, -0.2443,  0.3696,
          0.2693,  0.8735],
        [-0.3701,  1.1190,  1.4164,  1.8648,  1.2080,  0.0732,  1.5274,  0.6868,
          1.2440,  1.0715],
        [-1.2454, -0.0159,  0.4315,  0.1317,  1.0530, -1.0603, -0.0532,  0.6661,
          1.7101, -0.2076],
        [-0.7091,  0.7824,  1.7161,  1.2750,  0.6368,  1.2488,  0.4897,  1.2429,
          1.3409,  1.3735],
        [ 0.8345,  0.0653,  0.3462,  1.2383, -0.4092,  1.6438, -0.0962,  0.4011,
          0.2463, -0.5802],
        [ 1.6349,  0.7297,  1.2547, -0.3113,  0.9310,  0.1162,  1.7618,  0.4882,
          0.7640,  0.2930],
        [ 1.1669, -0.7775,  1.2000,  0.6008, -0.2814,  0.5541,  0.5753,  1.4731,
          1.6835,  0.7370],
        [ 1.5087,  0.6195,  0.1153,  1.2966,  1.8815,  1.1678,  1.5686,  1.6018,
          0.2193,  1.3500]])

In the same fashion, when compiling a module all sub-modules and methods within it, that are not in a skip list, are also compiled.

class OuterModule(torch.nn.Module):
    def __init__(self):
        super().__init__()
        self.inner_module = MyModule()
        self.outer_lin = torch.nn.Linear(10, 2)

    def forward(self, x):
        x = self.inner_module(x)
        return torch.nn.functional.relu(self.outer_lin(x))

outer_mod = OuterModule()
opt_outer_mod = torch.compile(outer_mod)
print(opt_outer_mod(t))
tensor([[0.0000, 0.1057],
        [0.0000, 0.2927],
        [0.0000, 0.0000],
        [0.3042, 0.0000],
        [0.0000, 0.0000],
        [0.1152, 0.2923],
        [0.0000, 0.1439],
        [0.0000, 0.4087],
        [0.0000, 0.2846],
        [0.2514, 0.4253]], grad_fn=<CompiledFunctionBackward>)

We can also disable some functions from being compiled by using torch.compiler.disable. Suppose you want to disable the tracing on just the complex_function function, but want to continue the tracing back in complex_conjugate. In this case, you can use torch.compiler.disable(recursive=False) option. Otherwise, the default is recursive=True.

def complex_conjugate(z):
    return torch.conj(z)

@torch.compiler.disable(recursive=False)
def complex_function(real, imag):
    # Assuming this function cause problems in the compilation
    z = torch.complex(real, imag)
    return complex_conjugate(z)

def outer_function():
    real = torch.tensor([2, 3], dtype=torch.float32)
    imag = torch.tensor([4, 5], dtype=torch.float32)
    z = complex_function(real, imag)
    return torch.abs(z)

# Try to compile the outer_function
try:
    opt_outer_function = torch.compile(outer_function)
    print(opt_outer_function())
except Exception as e:
    print("Compilation of outer_function failed:", e)
/usr/local/lib/python3.10/dist-packages/torch/_inductor/lowering.py:1713: UserWarning:

Torchinductor does not support code generation for complex operators. Performance may be worse than eager.

tensor([4.4721, 5.8310])

Best Practices and Recommendations

Behavior of torch.compile with Nested Modules and Function Calls

When you use torch.compile, the compiler will try to recursively compile every function call inside the target function or module inside the target function or module that is not in a skip list (such as built-ins, some functions in the torch.* namespace).

Best Practices:

1. Top-Level Compilation: One approach is to compile at the highest level possible (i.e., when the top-level module is initialized/called) and selectively disable compilation when encountering excessive graph breaks or errors. If there are still many compile issues, compile individual subcomponents instead.

2. Modular Testing: Test individual functions and modules with torch.compile before integrating them into larger models to isolate potential issues.

3. Disable Compilation Selectively: If certain functions or sub-modules cannot be handled by torch.compile, use the torch.compiler.disable context managers to recursively exclude them from compilation.

4. Compile Leaf Functions First: In complex models with multiple nested functions and modules, start by compiling the leaf functions or modules first. For more information see TorchDynamo APIs for fine-grained tracing.

Demonstrating Speedups

Let’s now demonstrate that using torch.compile can speed up real models. We will compare standard eager mode and torch.compile by evaluating and training a torchvision model on random data.

Before we start, we need to define some utility functions.

# Returns the result of running `fn()` and the time it took for `fn()` to run,
# in seconds. We use CUDA events and synchronization for the most accurate
# measurements.
def timed(fn):
    start = torch.cuda.Event(enable_timing=True)
    end = torch.cuda.Event(enable_timing=True)
    start.record()
    result = fn()
    end.record()
    torch.cuda.synchronize()
    return result, start.elapsed_time(end) / 1000

# Generates random input and targets data for the model, where `b` is
# batch size.
def generate_data(b):
    return (
        torch.randn(b, 3, 128, 128).to(torch.float32).cuda(),
        torch.randint(1000, (b,)).cuda(),
    )

N_ITERS = 10

from torchvision.models import densenet121
def init_model():
    return densenet121().to(torch.float32).cuda()

First, let’s compare inference.

Note that in the call to torch.compile, we have the additional mode argument, which we will discuss below.

model = init_model()

# Reset since we are using a different mode.
import torch._dynamo
torch._dynamo.reset()

model_opt = torch.compile(model, mode="reduce-overhead")

inp = generate_data(16)[0]
with torch.no_grad():
    print("eager:", timed(lambda: model(inp))[1])
    print("compile:", timed(lambda: model_opt(inp))[1])
eager: 0.3336734619140625
/usr/local/lib/python3.10/dist-packages/torch/_inductor/compile_fx.py:167: UserWarning:

TensorFloat32 tensor cores for float32 matrix multiplication available but not enabled. Consider setting `torch.set_float32_matmul_precision('high')` for better performance.

compile: 95.53209375

Notice that torch.compile takes a lot longer to complete compared to eager. This is because torch.compile compiles the model into optimized kernels as it executes. In our example, the structure of the model doesn’t change, and so recompilation is not needed. So if we run our optimized model several more times, we should see a significant improvement compared to eager.

eager_times = []
for i in range(N_ITERS):
    inp = generate_data(16)[0]
    with torch.no_grad():
        _, eager_time = timed(lambda: model(inp))
    eager_times.append(eager_time)
    print(f"eager eval time {i}: {eager_time}")

print("~" * 10)

compile_times = []
for i in range(N_ITERS):
    inp = generate_data(16)[0]
    with torch.no_grad():
        _, compile_time = timed(lambda: model_opt(inp))
    compile_times.append(compile_time)
    print(f"compile eval time {i}: {compile_time}")
print("~" * 10)

import numpy as np
eager_med = np.median(eager_times)
compile_med = np.median(compile_times)
speedup = eager_med / compile_med
assert(speedup > 1)
print(f"(eval) eager median: {eager_med}, compile median: {compile_med}, speedup: {speedup}x")
print("~" * 10)
eager eval time 0: 0.018272192001342773
eager eval time 1: 0.016709632873535156
eager eval time 2: 0.016536575317382812
eager eval time 3: 0.016746496200561522
eager eval time 4: 0.016532480239868166
eager eval time 5: 0.016542720794677734
eager eval time 6: 0.016991231918334963
eager eval time 7: 0.016563199996948243
eager eval time 8: 0.016474111557006836
eager eval time 9: 0.01717452812194824
~~~~~~~~~~
compile eval time 0: 0.697259033203125
compile eval time 1: 0.008752127647399903
compile eval time 2: 0.00890060806274414
compile eval time 3: 0.008164352416992187
compile eval time 4: 0.008148991584777832
compile eval time 5: 0.008154111862182617
compile eval time 6: 0.008152064323425292
compile eval time 7: 0.008130463600158691
compile eval time 8: 0.008138751983642578
compile eval time 9: 0.008124416351318359
~~~~~~~~~~
(eval) eager median: 0.016636416435241698, compile median: 0.008153088092803955, speedup: 2.040504928424024x
~~~~~~~~~~

And indeed, we can see that running our model with torch.compile results in a significant speedup. Speedup mainly comes from reducing Python overhead and GPU read/writes, and so the observed speedup may vary on factors such as model architecture and batch size. For example, if a model’s architecture is simple and the amount of data is large, then the bottleneck would be GPU compute and the observed speedup may be less significant.

You may also see different speedup results depending on the chosen mode argument. The "reduce-overhead" mode uses CUDA graphs to further reduce the overhead of Python. For your own models, you may need to experiment with different modes to maximize speedup. You can read more about modes here.

You may might also notice that the second time we run our model with torch.compile is significantly slower than the other runs, although it is much faster than the first run. This is because the "reduce-overhead" mode runs a few warm-up iterations for CUDA graphs.

For general PyTorch benchmarking, you can try using torch.utils.benchmark instead of the timed function we defined above. We wrote our own timing function in this tutorial to show torch.compile’s compilation latency.

Now, let’s consider comparing training.

model = init_model()
opt = torch.optim.Adam(model.parameters())

def train(mod, data):
    opt.zero_grad(True)
    pred = mod(data[0])
    loss = torch.nn.CrossEntropyLoss()(pred, data[1])
    loss.backward()
    opt.step()

eager_times = []
for i in range(N_ITERS):
    inp = generate_data(16)
    _, eager_time = timed(lambda: train(model, inp))
    eager_times.append(eager_time)
    print(f"eager train time {i}: {eager_time}")
print("~" * 10)

model = init_model()
opt = torch.optim.Adam(model.parameters())
train_opt = torch.compile(train, mode="reduce-overhead")

compile_times = []
for i in range(N_ITERS):
    inp = generate_data(16)
    _, compile_time = timed(lambda: train_opt(model, inp))
    compile_times.append(compile_time)
    print(f"compile train time {i}: {compile_time}")
print("~" * 10)

eager_med = np.median(eager_times)
compile_med = np.median(compile_times)
speedup = eager_med / compile_med
assert(speedup > 1)
print(f"(train) eager median: {eager_med}, compile median: {compile_med}, speedup: {speedup}x")
print("~" * 10)
eager train time 0: 0.2561464233398438
eager train time 1: 0.04964150238037109
eager train time 2: 0.04779212951660156
eager train time 3: 0.04752384185791016
eager train time 4: 0.04741641616821289
eager train time 5: 0.04792111968994141
eager train time 6: 0.04761907196044922
eager train time 7: 0.04765491104125977
eager train time 8: 0.047252479553222655
eager train time 9: 0.047290367126464845
~~~~~~~~~~
compile train time 0: 212.026296875
compile train time 1: 7.572890625
compile train time 2: 0.023315456390380858
compile train time 3: 0.02186854362487793
compile train time 4: 0.021037055969238282
compile train time 5: 0.02107798385620117
compile train time 6: 0.021163007736206055
compile train time 7: 0.020996095657348633
compile train time 8: 0.02103910446166992
compile train time 9: 0.020970495223999023
~~~~~~~~~~
(train) eager median: 0.04763699150085449, compile median: 0.021120495796203613, speedup: 2.2554864223129267x
~~~~~~~~~~

Again, we can see that torch.compile takes longer in the first iteration, as it must compile the model, but in subsequent iterations, we see significant speedups compared to eager.

We remark that the speedup numbers presented in this tutorial are for demonstration purposes only. Official speedup values can be seen at the TorchInductor performance dashboard.

Comparison to TorchScript and FX Tracing

We have seen that torch.compile can speed up PyTorch code. Why else should we use torch.compile over existing PyTorch compiler solutions, such as TorchScript or FX Tracing? Primarily, the advantage of torch.compile lies in its ability to handle arbitrary Python code with minimal changes to existing code.

One case that torch.compile can handle that other compiler solutions struggle with is data-dependent control flow (the if x.sum() < 0: line below).

def f1(x, y):
    if x.sum() < 0:
        return -y
    return y

# Test that `fn1` and `fn2` return the same result, given
# the same arguments `args`. Typically, `fn1` will be an eager function
# while `fn2` will be a compiled function (torch.compile, TorchScript, or FX graph).
def test_fns(fn1, fn2, args):
    out1 = fn1(*args)
    out2 = fn2(*args)
    return torch.allclose(out1, out2)

inp1 = torch.randn(5, 5)
inp2 = torch.randn(5, 5)

TorchScript tracing f1 results in silently incorrect results, since only the actual control flow path is traced.

traced_f1 = torch.jit.trace(f1, (inp1, inp2))
print("traced 1, 1:", test_fns(f1, traced_f1, (inp1, inp2)))
print("traced 1, 2:", test_fns(f1, traced_f1, (-inp1, inp2)))
/var/lib/workspace/intermediate_source/torch_compile_tutorial.py:372: TracerWarning:

Converting a tensor to a Python boolean might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!

traced 1, 1: True
traced 1, 2: False

FX tracing f1 results in an error due to the presence of data-dependent control flow.

import traceback as tb
try:
    torch.fx.symbolic_trace(f1)
except:
    tb.print_exc()
Traceback (most recent call last):
  File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 402, in <module>
    torch.fx.symbolic_trace(f1)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/_symbolic_trace.py", line 1281, in symbolic_trace
    graph = tracer.trace(root, concrete_args)
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/eval_frame.py", line 632, in _fn
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/_symbolic_trace.py", line 823, in trace
    (self.create_arg(fn(*args)),),
  File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 372, in f1
    if x.sum() < 0:
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/proxy.py", line 487, in __bool__
    return self.tracer.to_bool(self)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/proxy.py", line 318, in to_bool
    raise TraceError('symbolically traced variables cannot be used as inputs to control flow')
torch.fx.proxy.TraceError: symbolically traced variables cannot be used as inputs to control flow

If we provide a value for x as we try to FX trace f1, then we run into the same problem as TorchScript tracing, as the data-dependent control flow is removed in the traced function.

fx_f1 = torch.fx.symbolic_trace(f1, concrete_args={"x": inp1})
print("fx 1, 1:", test_fns(f1, fx_f1, (inp1, inp2)))
print("fx 1, 2:", test_fns(f1, fx_f1, (-inp1, inp2)))
/usr/local/lib/python3.10/dist-packages/torch/fx/_symbolic_trace.py:892: UserWarning:

Was not able to add assertion to guarantee correct input x to specialized function. It is up to the user to make sure that your inputs match the inputs you specialized the function with.

fx 1, 1: True
fx 1, 2: False

Now we can see that torch.compile correctly handles data-dependent control flow.

# Reset since we are using a different mode.
torch._dynamo.reset()

compile_f1 = torch.compile(f1)
print("compile 1, 1:", test_fns(f1, compile_f1, (inp1, inp2)))
print("compile 1, 2:", test_fns(f1, compile_f1, (-inp1, inp2)))
print("~" * 10)
compile 1, 1: True
compile 1, 2: True
~~~~~~~~~~

TorchScript scripting can handle data-dependent control flow, but this solution comes with its own set of problems. Namely, TorchScript scripting can require major code changes and will raise errors when unsupported Python is used.

In the example below, we forget TorchScript type annotations and we receive a TorchScript error because the input type for argument y, an int, does not match with the default argument type, torch.Tensor.

def f2(x, y):
    return x + y

inp1 = torch.randn(5, 5)
inp2 = 3

script_f2 = torch.jit.script(f2)
try:
    script_f2(inp1, inp2)
except:
    tb.print_exc()
Traceback (most recent call last):
  File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 445, in <module>
    script_f2(inp1, inp2)
RuntimeError: f2() Expected a value of type 'Tensor (inferred)' for argument 'y' but instead found type 'int'.
Inferred 'y' to be of type 'Tensor' because it was not annotated with an explicit type.
Position: 1
Value: 3
Declaration: f2(Tensor x, Tensor y) -> Tensor
Cast error details: Unable to cast 3 to Tensor

However, torch.compile is easily able to handle f2.

compile_f2 = torch.compile(f2)
print("compile 2:", test_fns(f2, compile_f2, (inp1, inp2)))
print("~" * 10)
compile 2: True
~~~~~~~~~~

Another case that torch.compile handles well compared to previous compilers solutions is the usage of non-PyTorch functions.

import scipy
def f3(x):
    x = x * 2
    x = scipy.fft.dct(x.numpy())
    x = torch.from_numpy(x)
    x = x * 2
    return x

TorchScript tracing treats results from non-PyTorch function calls as constants, and so our results can be silently wrong.

inp1 = torch.randn(5, 5)
inp2 = torch.randn(5, 5)
traced_f3 = torch.jit.trace(f3, (inp1,))
print("traced 3:", test_fns(f3, traced_f3, (inp2,)))
/usr/local/lib/python3.10/dist-packages/numpy/core/getlimits.py:518: UserWarning:

The value of the smallest subnormal for <class 'numpy.float64'> type is zero.

/usr/local/lib/python3.10/dist-packages/numpy/core/getlimits.py:89: UserWarning:

The value of the smallest subnormal for <class 'numpy.float64'> type is zero.

/usr/local/lib/python3.10/dist-packages/numpy/core/getlimits.py:518: UserWarning:

The value of the smallest subnormal for <class 'numpy.float32'> type is zero.

/usr/local/lib/python3.10/dist-packages/numpy/core/getlimits.py:89: UserWarning:

The value of the smallest subnormal for <class 'numpy.float32'> type is zero.

/var/lib/workspace/intermediate_source/torch_compile_tutorial.py:463: TracerWarning:

Converting a tensor to a NumPy array might cause the trace to be incorrect. We can't record the data flow of Python values, so this value will be treated as a constant in the future. This means that the trace might not generalize to other inputs!

/var/lib/workspace/intermediate_source/torch_compile_tutorial.py:464: TracerWarning:

torch.from_numpy results are registered as constants in the trace. You can safely ignore this warning if you use this function to create tensors out of constant variables that would be the same every time you call this function. In any other case, this might cause the trace to be incorrect.

traced 3: False

TorchScript scripting and FX tracing disallow non-PyTorch function calls.

try:
    torch.jit.script(f3)
except:
    tb.print_exc()

try:
    torch.fx.symbolic_trace(f3)
except:
    tb.print_exc()
Traceback (most recent call last):
  File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 481, in <module>
    torch.jit.script(f3)
  File "/usr/local/lib/python3.10/dist-packages/torch/jit/_script.py", line 1429, in script
    ret = _script_impl(
  File "/usr/local/lib/python3.10/dist-packages/torch/jit/_script.py", line 1205, in _script_impl
    fn = torch._C._jit_script_compile(
  File "/usr/local/lib/python3.10/dist-packages/torch/_jit_internal.py", line 1239, in _try_get_dispatched_fn
    return boolean_dispatched.get(fn)
  File "/usr/lib/python3.10/weakref.py", line 453, in get
    return self.data.get(ref(key),default)
TypeError: cannot create weak reference to 'uarray._Function' object
Traceback (most recent call last):
  File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 486, in <module>
    torch.fx.symbolic_trace(f3)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/_symbolic_trace.py", line 1281, in symbolic_trace
    graph = tracer.trace(root, concrete_args)
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/eval_frame.py", line 632, in _fn
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/_symbolic_trace.py", line 823, in trace
    (self.create_arg(fn(*args)),),
  File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 463, in f3
    x = scipy.fft.dct(x.numpy())
  File "/usr/local/lib/python3.10/dist-packages/scipy/fft/_backend.py", line 25, in __ua_function__
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/scipy/fft/_pocketfft/realtransforms.py", line 19, in _r2r
    tmp = _asfarray(x)
  File "/usr/local/lib/python3.10/dist-packages/scipy/fft/_pocketfft/helper.py", line 89, in _asfarray
    if x.dtype == np.float16:
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/proxy.py", line 592, in impl
    return tracer.create_proxy('call_function', target, args, kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/proxy.py", line 206, in create_proxy
    args_ = self.create_arg(args)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/_symbolic_trace.py", line 425, in create_arg
    return super().create_arg(a)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/proxy.py", line 273, in create_arg
    return type(a)(self.create_arg(elem) for elem in a)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/proxy.py", line 273, in <genexpr>
    return type(a)(self.create_arg(elem) for elem in a)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/_symbolic_trace.py", line 425, in create_arg
    return super().create_arg(a)
  File "/usr/local/lib/python3.10/dist-packages/torch/fx/proxy.py", line 309, in create_arg
    raise NotImplementedError(f"argument of type: {type(a)}")
NotImplementedError: argument of type: <class 'type'>

In comparison, torch.compile is easily able to handle the non-PyTorch function call.

compile_f3 = torch.compile(f3)
print("compile 3:", test_fns(f3, compile_f3, (inp2,)))
/usr/local/lib/python3.10/dist-packages/torch/_dynamo/variables/functions.py:725: UserWarning:

Graph break due to unsupported builtin scipy.fft._pocketfft.pypocketfft.PyCapsule.dct. This function is either a Python builtin (e.g. _warnings.warn) or a third-party C/C++ Python extension (perhaps created with pybind). If it is a Python builtin, please file an issue on GitHub so the PyTorch team can add support for it and see the next case for a workaround. If it is a third-party C/C++ Python extension, please either wrap it into a PyTorch-understood custom operator (see https://pytorch.org/tutorials/advanced/custom_ops_landing_page.html for more details) or, if it is traceable, use torch.compiler.allow_in_graph.

compile 3: True

TorchDynamo and FX Graphs

One important component of torch.compile is TorchDynamo. TorchDynamo is responsible for JIT compiling arbitrary Python code into FX graphs, which can then be further optimized. TorchDynamo extracts FX graphs by analyzing Python bytecode during runtime and detecting calls to PyTorch operations.

Normally, TorchInductor, another component of torch.compile, further compiles the FX graphs into optimized kernels, but TorchDynamo allows for different backends to be used. In order to inspect the FX graphs that TorchDynamo outputs, let us create a custom backend that outputs the FX graph and simply returns the graph’s unoptimized forward method.

from typing import List
def custom_backend(gm: torch.fx.GraphModule, example_inputs: List[torch.Tensor]):
    print("custom backend called with FX graph:")
    gm.graph.print_tabular()
    return gm.forward

# Reset since we are using a different backend.
torch._dynamo.reset()

opt_model = torch.compile(init_model(), backend=custom_backend)
opt_model(generate_data(16)[0])
custom backend called with FX graph:
opcode         name                                                                                                         target                                                                                                       args                                                                                                                                                                                                                                                                                                                                                                                                                                                     kwargs
-------------  -----------------------------------------------------------------------------------------------------------  -----------------------------------------------------------------------------------------------------------  -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------  ---------------------------------------------
placeholder    l_self_modules_features_modules_conv0_parameters_weight_                                                     L_self_modules_features_modules_conv0_parameters_weight_                                                     ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_x_                                                                                                         L_x_                                                                                                         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_norm0_buffers_num_batches_tracked_                                           L_self_modules_features_modules_norm0_buffers_num_batches_tracked_                                           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_norm0_buffers_running_mean_                                                  L_self_modules_features_modules_norm0_buffers_running_mean_                                                  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_norm0_buffers_running_var_                                                   L_self_modules_features_modules_norm0_buffers_running_var_                                                   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_norm0_parameters_weight_                                                     L_self_modules_features_modules_norm0_parameters_weight_                                                     ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_norm0_parameters_bias_                                                       L_self_modules_features_modules_norm0_parameters_bias_                                                       ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition1_modules_norm_buffers_num_batches_tracked_                        L_self_modules_features_modules_transition1_modules_norm_buffers_num_batches_tracked_                        ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition1_modules_norm_buffers_running_mean_                               L_self_modules_features_modules_transition1_modules_norm_buffers_running_mean_                               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition1_modules_norm_buffers_running_var_                                L_self_modules_features_modules_transition1_modules_norm_buffers_running_var_                                ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition1_modules_norm_parameters_weight_                                  L_self_modules_features_modules_transition1_modules_norm_parameters_weight_                                  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition1_modules_norm_parameters_bias_                                    L_self_modules_features_modules_transition1_modules_norm_parameters_bias_                                    ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition1_modules_conv_parameters_weight_                                  L_self_modules_features_modules_transition1_modules_conv_parameters_weight_                                  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition2_modules_norm_buffers_num_batches_tracked_                        L_self_modules_features_modules_transition2_modules_norm_buffers_num_batches_tracked_                        ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition2_modules_norm_buffers_running_mean_                               L_self_modules_features_modules_transition2_modules_norm_buffers_running_mean_                               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition2_modules_norm_buffers_running_var_                                L_self_modules_features_modules_transition2_modules_norm_buffers_running_var_                                ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition2_modules_norm_parameters_weight_                                  L_self_modules_features_modules_transition2_modules_norm_parameters_weight_                                  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition2_modules_norm_parameters_bias_                                    L_self_modules_features_modules_transition2_modules_norm_parameters_bias_                                    ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition2_modules_conv_parameters_weight_                                  L_self_modules_features_modules_transition2_modules_conv_parameters_weight_                                  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition3_modules_norm_buffers_num_batches_tracked_                        L_self_modules_features_modules_transition3_modules_norm_buffers_num_batches_tracked_                        ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition3_modules_norm_buffers_running_mean_                               L_self_modules_features_modules_transition3_modules_norm_buffers_running_mean_                               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition3_modules_norm_buffers_running_var_                                L_self_modules_features_modules_transition3_modules_norm_buffers_running_var_                                ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition3_modules_norm_parameters_weight_                                  L_self_modules_features_modules_transition3_modules_norm_parameters_weight_                                  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition3_modules_norm_parameters_bias_                                    L_self_modules_features_modules_transition3_modules_norm_parameters_bias_                                    ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_transition3_modules_conv_parameters_weight_                                  L_self_modules_features_modules_transition3_modules_conv_parameters_weight_                                  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv1_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv1_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_   L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_mean_          L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_mean_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_var_           L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_var_           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_bias_               L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_bias_               ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv2_parameters_weight_             L_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv2_parameters_weight_             ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv1_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv1_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_  L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_mean_         L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_mean_         ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_var_          L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_var_          ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_bias_              L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_bias_              ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv2_parameters_weight_            L_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv2_parameters_weight_            ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_norm5_buffers_num_batches_tracked_                                           L_self_modules_features_modules_norm5_buffers_num_batches_tracked_                                           ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_norm5_buffers_running_mean_                                                  L_self_modules_features_modules_norm5_buffers_running_mean_                                                  ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_norm5_buffers_running_var_                                                   L_self_modules_features_modules_norm5_buffers_running_var_                                                   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_norm5_parameters_weight_                                                     L_self_modules_features_modules_norm5_parameters_weight_                                                     ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_features_modules_norm5_parameters_bias_                                                       L_self_modules_features_modules_norm5_parameters_bias_                                                       ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_classifier_parameters_weight_                                                                 L_self_modules_classifier_parameters_weight_                                                                 ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
placeholder    l_self_modules_classifier_parameters_bias_                                                                   L_self_modules_classifier_parameters_bias_                                                                   ()                                                                                                                                                                                                                                                                                                                                                                                                                                                       {}
call_function  input_1                                                                                                      <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (l_x_, l_self_modules_features_modules_conv0_parameters_weight_, None, (2, 2), (3, 3), (1, 1), 1)                                                                                                                                                                                                                                                                                                                                                        {}
call_method    add_                                                                                                         add_                                                                                                         (l_self_modules_features_modules_norm0_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                                                                  {}
call_function  input_2                                                                                                      <function batch_norm at 0x7efe231c4f70>                                                                      (input_1, l_self_modules_features_modules_norm0_buffers_running_mean_, l_self_modules_features_modules_norm0_buffers_running_var_, l_self_modules_features_modules_norm0_parameters_weight_, l_self_modules_features_modules_norm0_parameters_bias_, True, 0.1, 1e-05)                                                                                                                                                                                   {}
call_function  input_3                                                                                                      <function relu at 0x7efe231aff40>                                                                            (input_2,)                                                                                                                                                                                                                                                                                                                                                                                                                                               {'inplace': True}
call_function  input_4                                                                                                      <function boolean_dispatch.<locals>.fn at 0x7efe231aedd0>                                                    (input_3, 3, 2, 1, 1)                                                                                                                                                                                                                                                                                                                                                                                                                                    {'ceil_mode': False, 'return_indices': False}
call_function  concated_features                                                                                            <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_4], 1)                                                                                                                                                                                                                                                                                                                                                                                                                                           {}
call_method    add__1                                                                                                       add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_1                                                                                                 <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm1_parameters_bias_, True, 0.1, 1e-05)         {}
call_function  relu_1                                                                                                       <function relu at 0x7efe231aff40>                                                                            (batch_norm_1,)                                                                                                                                                                                                                                                                                                                                                                                                                                          {'inplace': True}
call_function  bottleneck_output                                                                                            <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_1, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                              {}
call_method    add__2                                                                                                       add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_2                                                                                                 <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_norm2_parameters_bias_, True, 0.1, 1e-05)         {}
call_function  relu_2                                                                                                       <function relu at 0x7efe231aff40>                                                                            (batch_norm_2,)                                                                                                                                                                                                                                                                                                                                                                                                                                          {'inplace': True}
call_function  new_features                                                                                                 <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_2, l_self_modules_features_modules_denseblock1_modules_denselayer1_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                              {}
call_function  concated_features_1                                                                                          <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_4, new_features], 1)                                                                                                                                                                                                                                                                                                                                                                                                                             {}
call_method    add__3                                                                                                       add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_3                                                                                                 <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_1, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm1_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_3                                                                                                       <function relu at 0x7efe231aff40>                                                                            (batch_norm_3,)                                                                                                                                                                                                                                                                                                                                                                                                                                          {'inplace': True}
call_function  bottleneck_output_1                                                                                          <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_3, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                              {}
call_method    add__4                                                                                                       add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_4                                                                                                 <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_1, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_norm2_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_4                                                                                                       <function relu at 0x7efe231aff40>                                                                            (batch_norm_4,)                                                                                                                                                                                                                                                                                                                                                                                                                                          {'inplace': True}
call_function  new_features_1                                                                                               <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_4, l_self_modules_features_modules_denseblock1_modules_denselayer2_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                              {}
call_function  concated_features_2                                                                                          <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_4, new_features, new_features_1], 1)                                                                                                                                                                                                                                                                                                                                                                                                             {}
call_method    add__5                                                                                                       add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_5                                                                                                 <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_2, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm1_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_5                                                                                                       <function relu at 0x7efe231aff40>                                                                            (batch_norm_5,)                                                                                                                                                                                                                                                                                                                                                                                                                                          {'inplace': True}
call_function  bottleneck_output_2                                                                                          <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_5, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                              {}
call_method    add__6                                                                                                       add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_6                                                                                                 <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_2, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_norm2_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_6                                                                                                       <function relu at 0x7efe231aff40>                                                                            (batch_norm_6,)                                                                                                                                                                                                                                                                                                                                                                                                                                          {'inplace': True}
call_function  new_features_2                                                                                               <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_6, l_self_modules_features_modules_denseblock1_modules_denselayer3_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                              {}
call_function  concated_features_3                                                                                          <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_4, new_features, new_features_1, new_features_2], 1)                                                                                                                                                                                                                                                                                                                                                                                             {}
call_method    add__7                                                                                                       add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_7                                                                                                 <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_3, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm1_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_7                                                                                                       <function relu at 0x7efe231aff40>                                                                            (batch_norm_7,)                                                                                                                                                                                                                                                                                                                                                                                                                                          {'inplace': True}
call_function  bottleneck_output_3                                                                                          <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_7, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                              {}
call_method    add__8                                                                                                       add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_8                                                                                                 <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_3, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_norm2_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_8                                                                                                       <function relu at 0x7efe231aff40>                                                                            (batch_norm_8,)                                                                                                                                                                                                                                                                                                                                                                                                                                          {'inplace': True}
call_function  new_features_3                                                                                               <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_8, l_self_modules_features_modules_denseblock1_modules_denselayer4_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                              {}
call_function  concated_features_4                                                                                          <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_4, new_features, new_features_1, new_features_2, new_features_3], 1)                                                                                                                                                                                                                                                                                                                                                                             {}
call_method    add__9                                                                                                       add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_9                                                                                                 <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_4, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm1_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_9                                                                                                       <function relu at 0x7efe231aff40>                                                                            (batch_norm_9,)                                                                                                                                                                                                                                                                                                                                                                                                                                          {'inplace': True}
call_function  bottleneck_output_4                                                                                          <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_9, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                              {}
call_method    add__10                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_10                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_4, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_norm2_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_10                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_10,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_4                                                                                               <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_10, l_self_modules_features_modules_denseblock1_modules_denselayer5_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_5                                                                                          <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_4, new_features, new_features_1, new_features_2, new_features_3, new_features_4], 1)                                                                                                                                                                                                                                                                                                                                                             {}
call_method    add__11                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_11                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_5, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm1_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_11                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_11,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_5                                                                                          <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_11, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__12                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_12                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_5, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_norm2_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_12                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_12,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_5                                                                                               <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_12, l_self_modules_features_modules_denseblock1_modules_denselayer6_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  input_5                                                                                                      <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_4, new_features, new_features_1, new_features_2, new_features_3, new_features_4, new_features_5], 1)                                                                                                                                                                                                                                                                                                                                             {}
call_method    add__13                                                                                                      add_                                                                                                         (l_self_modules_features_modules_transition1_modules_norm_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                                               {}
call_function  input_6                                                                                                      <function batch_norm at 0x7efe231c4f70>                                                                      (input_5, l_self_modules_features_modules_transition1_modules_norm_buffers_running_mean_, l_self_modules_features_modules_transition1_modules_norm_buffers_running_var_, l_self_modules_features_modules_transition1_modules_norm_parameters_weight_, l_self_modules_features_modules_transition1_modules_norm_parameters_bias_, True, 0.1, 1e-05)                                                                                                       {}
call_function  input_7                                                                                                      <function relu at 0x7efe231aff40>                                                                            (input_6,)                                                                                                                                                                                                                                                                                                                                                                                                                                               {'inplace': True}
call_function  input_8                                                                                                      <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (input_7, l_self_modules_features_modules_transition1_modules_conv_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                                                  {}
call_function  input_9                                                                                                      <built-in function avg_pool2d>                                                                               (input_8, 2, 2, 0, False, True, None)                                                                                                                                                                                                                                                                                                                                                                                                                    {}
call_function  concated_features_6                                                                                          <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9], 1)                                                                                                                                                                                                                                                                                                                                                                                                                                           {}
call_method    add__14                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_14                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_6, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm1_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_14                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_14,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_6                                                                                          <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_14, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__15                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_15                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_6, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_norm2_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_15                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_15,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_6                                                                                               <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_15, l_self_modules_features_modules_denseblock2_modules_denselayer1_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_7                                                                                          <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6], 1)                                                                                                                                                                                                                                                                                                                                                                                                                           {}
call_method    add__16                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_16                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_7, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm1_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_16                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_16,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_7                                                                                          <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_16, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__17                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_17                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_7, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_norm2_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_17                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_17,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_7                                                                                               <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_17, l_self_modules_features_modules_denseblock2_modules_denselayer2_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_8                                                                                          <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7], 1)                                                                                                                                                                                                                                                                                                                                                                                                           {}
call_method    add__18                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_18                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_8, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm1_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_18                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_18,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_8                                                                                          <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_18, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__19                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_19                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_8, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_norm2_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_19                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_19,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_8                                                                                               <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_19, l_self_modules_features_modules_denseblock2_modules_denselayer3_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_9                                                                                          <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7, new_features_8], 1)                                                                                                                                                                                                                                                                                                                                                                                           {}
call_method    add__20                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_20                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_9, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm1_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_20                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_20,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_9                                                                                          <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_20, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__21                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_21                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_9, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_norm2_parameters_bias_, True, 0.1, 1e-05)       {}
call_function  relu_21                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_21,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_9                                                                                               <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_21, l_self_modules_features_modules_denseblock2_modules_denselayer4_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_10                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7, new_features_8, new_features_9], 1)                                                                                                                                                                                                                                                                                                                                                                           {}
call_method    add__22                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_22                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_10, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_22                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_22,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_10                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_22, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__23                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_23                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_10, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_23                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_23,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_10                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_23, l_self_modules_features_modules_denseblock2_modules_denselayer5_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_11                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10], 1)                                                                                                                                                                                                                                                                                                                                                          {}
call_method    add__24                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_24                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_11, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_24                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_24,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_11                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_24, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__25                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_25                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_11, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_25                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_25,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_11                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_25, l_self_modules_features_modules_denseblock2_modules_denselayer6_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_12                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11], 1)                                                                                                                                                                                                                                                                                                                                         {}
call_method    add__26                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_26                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_12, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_26                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_26,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_12                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_26, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__27                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_27                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_12, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_27                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_27,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_12                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_27, l_self_modules_features_modules_denseblock2_modules_denselayer7_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_13                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12], 1)                                                                                                                                                                                                                                                                                                                        {}
call_method    add__28                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_28                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_13, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_28                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_28,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_13                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_28, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__29                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_29                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_13, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_29                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_29,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_13                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_29, l_self_modules_features_modules_denseblock2_modules_denselayer8_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_14                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12, new_features_13], 1)                                                                                                                                                                                                                                                                                                       {}
call_method    add__30                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_30                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_14, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_30                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_30,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_14                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_30, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__31                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_31                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_14, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_31                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_31,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_14                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_31, l_self_modules_features_modules_denseblock2_modules_denselayer9_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_15                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12, new_features_13, new_features_14], 1)                                                                                                                                                                                                                                                                                      {}
call_method    add__32                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_32                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_15, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_32                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_32,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_15                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_32, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__33                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_33                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_15, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_33                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_33,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_15                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_33, l_self_modules_features_modules_denseblock2_modules_denselayer10_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_16                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12, new_features_13, new_features_14, new_features_15], 1)                                                                                                                                                                                                                                                                     {}
call_method    add__34                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_34                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_16, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_34                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_34,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_16                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_34, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__35                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_35                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_16, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_35                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_35,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_16                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_35, l_self_modules_features_modules_denseblock2_modules_denselayer11_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_17                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12, new_features_13, new_features_14, new_features_15, new_features_16], 1)                                                                                                                                                                                                                                                    {}
call_method    add__36                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_36                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_17, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_36                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_36,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_17                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_36, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__37                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_37                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_17, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_37                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_37,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_17                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_37, l_self_modules_features_modules_denseblock2_modules_denselayer12_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  input_10                                                                                                     <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_9, new_features_6, new_features_7, new_features_8, new_features_9, new_features_10, new_features_11, new_features_12, new_features_13, new_features_14, new_features_15, new_features_16, new_features_17], 1)                                                                                                                                                                                                                                   {}
call_method    add__38                                                                                                      add_                                                                                                         (l_self_modules_features_modules_transition2_modules_norm_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                                               {}
call_function  input_11                                                                                                     <function batch_norm at 0x7efe231c4f70>                                                                      (input_10, l_self_modules_features_modules_transition2_modules_norm_buffers_running_mean_, l_self_modules_features_modules_transition2_modules_norm_buffers_running_var_, l_self_modules_features_modules_transition2_modules_norm_parameters_weight_, l_self_modules_features_modules_transition2_modules_norm_parameters_bias_, True, 0.1, 1e-05)                                                                                                      {}
call_function  input_12                                                                                                     <function relu at 0x7efe231aff40>                                                                            (input_11,)                                                                                                                                                                                                                                                                                                                                                                                                                                              {'inplace': True}
call_function  input_13                                                                                                     <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (input_12, l_self_modules_features_modules_transition2_modules_conv_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                                                 {}
call_function  input_14                                                                                                     <built-in function avg_pool2d>                                                                               (input_13, 2, 2, 0, False, True, None)                                                                                                                                                                                                                                                                                                                                                                                                                   {}
call_function  concated_features_18                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14], 1)                                                                                                                                                                                                                                                                                                                                                                                                                                          {}
call_method    add__39                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_39                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_18, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_39                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_39,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_18                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_39, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__40                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_40                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_18, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_40                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_40,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_18                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_40, l_self_modules_features_modules_denseblock3_modules_denselayer1_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_19                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18], 1)                                                                                                                                                                                                                                                                                                                                                                                                                         {}
call_method    add__41                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_41                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_19, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_41                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_41,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_19                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_41, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__42                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_42                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_19, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_42                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_42,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_19                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_42, l_self_modules_features_modules_denseblock3_modules_denselayer2_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_20                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19], 1)                                                                                                                                                                                                                                                                                                                                                                                                        {}
call_method    add__43                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_43                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_20, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_43                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_43,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_20                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_43, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__44                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_44                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_20, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_44                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_44,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_20                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_44, l_self_modules_features_modules_denseblock3_modules_denselayer3_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_21                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20], 1)                                                                                                                                                                                                                                                                                                                                                                                       {}
call_method    add__45                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_45                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_21, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_45                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_45,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_21                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_45, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__46                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_46                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_21, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_46                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_46,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_21                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_46, l_self_modules_features_modules_denseblock3_modules_denselayer4_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_22                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21], 1)                                                                                                                                                                                                                                                                                                                                                                      {}
call_method    add__47                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_47                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_22, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_47                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_47,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_22                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_47, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__48                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_48                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_22, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_48                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_48,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_22                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_48, l_self_modules_features_modules_denseblock3_modules_denselayer5_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_23                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22], 1)                                                                                                                                                                                                                                                                                                                                                     {}
call_method    add__49                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_49                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_23, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_49                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_49,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_23                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_49, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__50                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_50                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_23, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_50                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_50,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_23                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_50, l_self_modules_features_modules_denseblock3_modules_denselayer6_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_24                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23], 1)                                                                                                                                                                                                                                                                                                                                    {}
call_method    add__51                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_51                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_24, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_51                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_51,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_24                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_51, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__52                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_52                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_24, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_52                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_52,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_24                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_52, l_self_modules_features_modules_denseblock3_modules_denselayer7_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_25                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24], 1)                                                                                                                                                                                                                                                                                                                   {}
call_method    add__53                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_53                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_25, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_53                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_53,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_25                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_53, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__54                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_54                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_25, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_54                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_54,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_25                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_54, l_self_modules_features_modules_denseblock3_modules_denselayer8_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_26                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25], 1)                                                                                                                                                                                                                                                                                                  {}
call_method    add__55                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_55                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_26, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_55                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_55,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_26                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_55, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__56                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_56                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_26, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_56                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_56,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_26                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_56, l_self_modules_features_modules_denseblock3_modules_denselayer9_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_27                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26], 1)                                                                                                                                                                                                                                                                                 {}
call_method    add__57                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_57                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_27, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_57                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_57,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_27                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_57, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__58                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_58                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_27, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_58                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_58,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_27                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_58, l_self_modules_features_modules_denseblock3_modules_denselayer10_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_28                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27], 1)                                                                                                                                                                                                                                                                {}
call_method    add__59                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_59                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_28, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_59                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_59,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_28                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_59, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__60                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_60                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_28, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_60                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_60,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_28                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_60, l_self_modules_features_modules_denseblock3_modules_denselayer11_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_29                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28], 1)                                                                                                                                                                                                                                               {}
call_method    add__61                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_61                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_29, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_61                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_61,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_29                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_61, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__62                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_62                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_29, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_62                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_62,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_29                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_62, l_self_modules_features_modules_denseblock3_modules_denselayer12_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_30                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29], 1)                                                                                                                                                                                                                              {}
call_method    add__63                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_63                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_30, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_63                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_63,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_30                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_63, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__64                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_64                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_30, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_64                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_64,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_30                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_64, l_self_modules_features_modules_denseblock3_modules_denselayer13_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_31                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30], 1)                                                                                                                                                                                                             {}
call_method    add__65                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_65                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_31, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_65                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_65,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_31                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_65, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__66                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_66                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_31, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_66                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_66,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_31                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_66, l_self_modules_features_modules_denseblock3_modules_denselayer14_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_32                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31], 1)                                                                                                                                                                                            {}
call_method    add__67                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_67                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_32, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_67                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_67,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_32                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_67, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__68                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_68                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_32, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_68                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_68,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_32                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_68, l_self_modules_features_modules_denseblock3_modules_denselayer15_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_33                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32], 1)                                                                                                                                                                           {}
call_method    add__69                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_69                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_33, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_69                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_69,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_33                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_69, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__70                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_70                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_33, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_70                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_70,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_33                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_70, l_self_modules_features_modules_denseblock3_modules_denselayer16_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_34                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33], 1)                                                                                                                                                          {}
call_method    add__71                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_71                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_34, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_71                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_71,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_34                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_71, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__72                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_72                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_34, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_72                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_72,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_34                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_72, l_self_modules_features_modules_denseblock3_modules_denselayer17_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_35                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34], 1)                                                                                                                                         {}
call_method    add__73                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_73                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_35, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_73                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_73,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_35                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_73, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__74                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_74                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_35, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_74                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_74,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_35                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_74, l_self_modules_features_modules_denseblock3_modules_denselayer18_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_36                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35], 1)                                                                                                                        {}
call_method    add__75                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_75                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_36, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_75                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_75,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_36                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_75, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__76                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_76                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_36, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_76                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_76,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_36                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_76, l_self_modules_features_modules_denseblock3_modules_denselayer19_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_37                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36], 1)                                                                                                       {}
call_method    add__77                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_77                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_37, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_77                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_77,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_37                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_77, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__78                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_78                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_37, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_78                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_78,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_37                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_78, l_self_modules_features_modules_denseblock3_modules_denselayer20_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_38                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36, new_features_37], 1)                                                                                      {}
call_method    add__79                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_79                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_38, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_79                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_79,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_38                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_79, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__80                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_80                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_38, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_80                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_80,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_38                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_80, l_self_modules_features_modules_denseblock3_modules_denselayer21_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_39                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36, new_features_37, new_features_38], 1)                                                                     {}
call_method    add__81                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_81                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_39, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_81                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_81,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_39                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_81, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__82                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_82                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_39, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_82                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_82,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_39                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_82, l_self_modules_features_modules_denseblock3_modules_denselayer22_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_40                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36, new_features_37, new_features_38, new_features_39], 1)                                                    {}
call_method    add__83                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_83                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_40, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_83                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_83,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_40                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_83, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__84                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_84                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_40, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_84                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_84,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_40                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_84, l_self_modules_features_modules_denseblock3_modules_denselayer23_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_41                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36, new_features_37, new_features_38, new_features_39, new_features_40], 1)                                   {}
call_method    add__85                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_85                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_41, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_85                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_85,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_41                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_85, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__86                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_86                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_41, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_86                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_86,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_41                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_86, l_self_modules_features_modules_denseblock3_modules_denselayer24_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  input_15                                                                                                     <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_14, new_features_18, new_features_19, new_features_20, new_features_21, new_features_22, new_features_23, new_features_24, new_features_25, new_features_26, new_features_27, new_features_28, new_features_29, new_features_30, new_features_31, new_features_32, new_features_33, new_features_34, new_features_35, new_features_36, new_features_37, new_features_38, new_features_39, new_features_40, new_features_41], 1)                  {}
call_method    add__87                                                                                                      add_                                                                                                         (l_self_modules_features_modules_transition3_modules_norm_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                                               {}
call_function  input_16                                                                                                     <function batch_norm at 0x7efe231c4f70>                                                                      (input_15, l_self_modules_features_modules_transition3_modules_norm_buffers_running_mean_, l_self_modules_features_modules_transition3_modules_norm_buffers_running_var_, l_self_modules_features_modules_transition3_modules_norm_parameters_weight_, l_self_modules_features_modules_transition3_modules_norm_parameters_bias_, True, 0.1, 1e-05)                                                                                                      {}
call_function  input_17                                                                                                     <function relu at 0x7efe231aff40>                                                                            (input_16,)                                                                                                                                                                                                                                                                                                                                                                                                                                              {'inplace': True}
call_function  input_18                                                                                                     <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (input_17, l_self_modules_features_modules_transition3_modules_conv_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                                                 {}
call_function  input_19                                                                                                     <built-in function avg_pool2d>                                                                               (input_18, 2, 2, 0, False, True, None)                                                                                                                                                                                                                                                                                                                                                                                                                   {}
call_function  concated_features_42                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19], 1)                                                                                                                                                                                                                                                                                                                                                                                                                                          {}
call_method    add__88                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_88                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_42, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_88                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_88,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_42                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_88, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__89                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_89                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_42, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_89                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_89,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_42                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_89, l_self_modules_features_modules_denseblock4_modules_denselayer1_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_43                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42], 1)                                                                                                                                                                                                                                                                                                                                                                                                                         {}
call_method    add__90                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_90                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_43, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_90                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_90,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_43                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_90, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__91                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_91                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_43, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_91                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_91,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_43                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_91, l_self_modules_features_modules_denseblock4_modules_denselayer2_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_44                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43], 1)                                                                                                                                                                                                                                                                                                                                                                                                        {}
call_method    add__92                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_92                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_44, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_92                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_92,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_44                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_92, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__93                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_93                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_44, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_93                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_93,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_44                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_93, l_self_modules_features_modules_denseblock4_modules_denselayer3_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_45                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44], 1)                                                                                                                                                                                                                                                                                                                                                                                       {}
call_method    add__94                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_94                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_45, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_94                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_94,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_45                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_94, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__95                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_95                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_45, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_95                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_95,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_45                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_95, l_self_modules_features_modules_denseblock4_modules_denselayer4_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_46                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45], 1)                                                                                                                                                                                                                                                                                                                                                                      {}
call_method    add__96                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_96                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_46, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_96                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_96,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_46                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_96, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__97                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_97                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_46, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_97                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_97,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_46                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_97, l_self_modules_features_modules_denseblock4_modules_denselayer5_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_47                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46], 1)                                                                                                                                                                                                                                                                                                                                                     {}
call_method    add__98                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_98                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_47, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_98                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_98,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  bottleneck_output_47                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_98, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_method    add__99                                                                                                      add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_99                                                                                                <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_47, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_99                                                                                                      <function relu at 0x7efe231aff40>                                                                            (batch_norm_99,)                                                                                                                                                                                                                                                                                                                                                                                                                                         {'inplace': True}
call_function  new_features_47                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_99, l_self_modules_features_modules_denseblock4_modules_denselayer6_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                             {}
call_function  concated_features_48                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47], 1)                                                                                                                                                                                                                                                                                                                                    {}
call_method    add__100                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_100                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_48, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_100                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_100,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  bottleneck_output_48                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_100, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__101                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_101                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_48, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_101                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_101,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  new_features_48                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_101, l_self_modules_features_modules_denseblock4_modules_denselayer7_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_49                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48], 1)                                                                                                                                                                                                                                                                                                                   {}
call_method    add__102                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_102                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_49, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_102                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_102,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  bottleneck_output_49                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_102, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__103                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_103                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_49, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_103                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_103,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  new_features_49                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_103, l_self_modules_features_modules_denseblock4_modules_denselayer8_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_50                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49], 1)                                                                                                                                                                                                                                                                                                  {}
call_method    add__104                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_104                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_50, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm1_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_104                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_104,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  bottleneck_output_50                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_104, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_method    add__105                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                          {}
call_function  batch_norm_105                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_50, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_norm2_parameters_bias_, True, 0.1, 1e-05)      {}
call_function  relu_105                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_105,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  new_features_50                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_105, l_self_modules_features_modules_denseblock4_modules_denselayer9_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                            {}
call_function  concated_features_51                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50], 1)                                                                                                                                                                                                                                                                                 {}
call_method    add__106                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_106                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_51, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_106                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_106,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  bottleneck_output_51                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_106, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_method    add__107                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_107                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_51, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_107                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_107,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  new_features_51                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_107, l_self_modules_features_modules_denseblock4_modules_denselayer10_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_function  concated_features_52                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51], 1)                                                                                                                                                                                                                                                                {}
call_method    add__108                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_108                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_52, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_108                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_108,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  bottleneck_output_52                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_108, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_method    add__109                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_109                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_52, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_109                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_109,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  new_features_52                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_109, l_self_modules_features_modules_denseblock4_modules_denselayer11_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_function  concated_features_53                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52], 1)                                                                                                                                                                                                                                               {}
call_method    add__110                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_110                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_53, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_110                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_110,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  bottleneck_output_53                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_110, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_method    add__111                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_111                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_53, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_111                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_111,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  new_features_53                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_111, l_self_modules_features_modules_denseblock4_modules_denselayer12_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_function  concated_features_54                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52, new_features_53], 1)                                                                                                                                                                                                                              {}
call_method    add__112                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_112                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_54, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_112                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_112,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  bottleneck_output_54                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_112, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_method    add__113                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_113                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_54, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_113                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_113,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  new_features_54                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_113, l_self_modules_features_modules_denseblock4_modules_denselayer13_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_function  concated_features_55                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52, new_features_53, new_features_54], 1)                                                                                                                                                                                                             {}
call_method    add__114                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_114                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_55, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_114                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_114,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  bottleneck_output_55                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_114, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_method    add__115                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_115                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_55, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_115                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_115,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  new_features_55                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_115, l_self_modules_features_modules_denseblock4_modules_denselayer14_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_function  concated_features_56                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52, new_features_53, new_features_54, new_features_55], 1)                                                                                                                                                                                            {}
call_method    add__116                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_116                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_56, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_116                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_116,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  bottleneck_output_56                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_116, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_method    add__117                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_117                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_56, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_117                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_117,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  new_features_56                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_117, l_self_modules_features_modules_denseblock4_modules_denselayer15_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_function  concated_features_57                                                                                         <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52, new_features_53, new_features_54, new_features_55, new_features_56], 1)                                                                                                                                                                           {}
call_method    add__118                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_118                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (concated_features_57, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm1_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_118                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_118,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  bottleneck_output_57                                                                                         <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_118, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv1_parameters_weight_, None, (1, 1), (0, 0), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_method    add__119                                                                                                     add_                                                                                                         (l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                         {}
call_function  batch_norm_119                                                                                               <function batch_norm at 0x7efe231c4f70>                                                                      (bottleneck_output_57, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_mean_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_buffers_running_var_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_weight_, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_norm2_parameters_bias_, True, 0.1, 1e-05)  {}
call_function  relu_119                                                                                                     <function relu at 0x7efe231aff40>                                                                            (batch_norm_119,)                                                                                                                                                                                                                                                                                                                                                                                                                                        {'inplace': True}
call_function  new_features_57                                                                                              <built-in method conv2d of type object at 0x7eff0805f1c0>                                                    (relu_119, l_self_modules_features_modules_denseblock4_modules_denselayer16_modules_conv2_parameters_weight_, None, (1, 1), (1, 1), (1, 1), 1)                                                                                                                                                                                                                                                                                                           {}
call_function  input_20                                                                                                     <built-in method cat of type object at 0x7eff0805f1c0>                                                       ([input_19, new_features_42, new_features_43, new_features_44, new_features_45, new_features_46, new_features_47, new_features_48, new_features_49, new_features_50, new_features_51, new_features_52, new_features_53, new_features_54, new_features_55, new_features_56, new_features_57], 1)                                                                                                                                                          {}
call_method    add__120                                                                                                     add_                                                                                                         (l_self_modules_features_modules_norm5_buffers_num_batches_tracked_, 1)                                                                                                                                                                                                                                                                                                                                                                                  {}
call_function  input_21                                                                                                     <function batch_norm at 0x7efe231c4f70>                                                                      (input_20, l_self_modules_features_modules_norm5_buffers_running_mean_, l_self_modules_features_modules_norm5_buffers_running_var_, l_self_modules_features_modules_norm5_parameters_weight_, l_self_modules_features_modules_norm5_parameters_bias_, True, 0.1, 1e-05)                                                                                                                                                                                  {}
call_function  out                                                                                                          <function relu at 0x7efe231aff40>                                                                            (input_21,)                                                                                                                                                                                                                                                                                                                                                                                                                                              {'inplace': True}
call_function  out_1                                                                                                        <function adaptive_avg_pool2d at 0x7efe231afa30>                                                             (out, (1, 1))                                                                                                                                                                                                                                                                                                                                                                                                                                            {}
call_function  out_2                                                                                                        <built-in method flatten of type object at 0x7eff0805f1c0>                                                   (out_1, 1)                                                                                                                                                                                                                                                                                                                                                                                                                                               {}
call_function  out_3                                                                                                        <built-in function linear>                                                                                   (out_2, l_self_modules_classifier_parameters_weight_, l_self_modules_classifier_parameters_bias_)                                                                                                                                                                                                                                                                                                                                                        {}
output         output                                                                                                       output                                                                                                       ((out_3,),)                                                                                                                                                                                                                                                                                                                                                                                                                                              {}

tensor([[-0.2418, -0.1561, -0.5042,  ...,  0.0503,  0.0784, -0.2087],
        [-0.2150, -0.2956, -0.4718,  ...,  0.0413,  0.0322, -0.2366],
        [-0.2173, -0.3720, -0.3057,  ...,  0.1889,  0.0051, -0.1921],
        ...,
        [-0.2988, -0.1019, -0.5952,  ...,  0.3599, -0.2925, -0.1095],
        [-0.2934, -0.0464, -0.4527,  ...,  0.0396, -0.0903, -0.2320],
        [-0.1442,  0.0545, -0.4443,  ...,  0.1844, -0.1573, -0.2857]],
       device='cuda:0', grad_fn=<AddmmBackward0>)

Using our custom backend, we can now see how TorchDynamo is able to handle data-dependent control flow. Consider the function below, where the line if b.sum() < 0 is the source of data-dependent control flow.

def bar(a, b):
    x = a / (torch.abs(a) + 1)
    if b.sum() < 0:
        b = b * -1
    return x * b

opt_bar = torch.compile(bar, backend=custom_backend)
inp1 = torch.randn(10)
inp2 = torch.randn(10)
opt_bar(inp1, inp2)
opt_bar(inp1, -inp2)
custom backend called with FX graph:
opcode         name    target                                                  args         kwargs
-------------  ------  ------------------------------------------------------  -----------  --------
placeholder    l_a_    L_a_                                                    ()           {}
placeholder    l_b_    L_b_                                                    ()           {}
call_function  abs_1   <built-in method abs of type object at 0x7eff0805f1c0>  (l_a_,)      {}
call_function  add     <built-in function add>                                 (abs_1, 1)   {}
call_function  x       <built-in function truediv>                             (l_a_, add)  {}
call_method    sum_1   sum                                                     (l_b_,)      {}
call_function  lt      <built-in function lt>                                  (sum_1, 0)   {}
output         output  output                                                  ((x, lt),)   {}
custom backend called with FX graph:
opcode         name    target                   args          kwargs
-------------  ------  -----------------------  ------------  --------
placeholder    l_x_    L_x_                     ()            {}
placeholder    l_b_    L_b_                     ()            {}
call_function  mul     <built-in function mul>  (l_x_, l_b_)  {}
output         output  output                   ((mul,),)     {}
custom backend called with FX graph:
opcode         name    target                   args         kwargs
-------------  ------  -----------------------  -----------  --------
placeholder    l_b_    L_b_                     ()           {}
placeholder    l_x_    L_x_                     ()           {}
call_function  b       <built-in function mul>  (l_b_, -1)   {}
call_function  mul_1   <built-in function mul>  (l_x_, b)    {}
output         output  output                   ((mul_1,),)  {}

tensor([-0.1181,  0.1225,  0.2214, -0.0173, -0.7982,  0.6274, -0.4151, -0.9775,
        -0.2735,  1.0795])

The output reveals that TorchDynamo extracted 3 different FX graphs corresponding the following code (order may differ from the output above):

  1. x = a / (torch.abs(a) + 1)

  2. b = b * -1; return x * b

  3. return x * b

When TorchDynamo encounters unsupported Python features, such as data-dependent control flow, it breaks the computation graph, lets the default Python interpreter handle the unsupported code, then resumes capturing the graph.

Let’s investigate by example how TorchDynamo would step through bar. If b.sum() < 0, then TorchDynamo would run graph 1, let Python determine the result of the conditional, then run graph 2. On the other hand, if not b.sum() < 0, then TorchDynamo would run graph 1, let Python determine the result of the conditional, then run graph 3.

This highlights a major difference between TorchDynamo and previous PyTorch compiler solutions. When encountering unsupported Python features, previous solutions either raise an error or silently fail. TorchDynamo, on the other hand, will break the computation graph.

We can see where TorchDynamo breaks the graph by using torch._dynamo.explain:

# Reset since we are using a different backend.
torch._dynamo.reset()
explain_output = torch._dynamo.explain(bar)(torch.randn(10), torch.randn(10))
print(explain_output)
Graph Count: 2
Graph Break Count: 1
Op Count: 6
Break Reasons:
  Break Reason 1:
    Reason: generic_jump TensorVariable()
    User Stack:
      <FrameSummary file /var/lib/workspace/intermediate_source/torch_compile_tutorial.py, line 532 in bar>
Ops per Graph:
  Ops 1:
    <built-in method abs of type object at 0x7eff0805f1c0>
    <built-in function add>
    <built-in function truediv>
    <built-in function lt>
  Ops 2:
    <built-in function mul>
    <built-in function mul>
Out Guards:
  Guard 1:
    Name: "G['torch'].abs"
    Source: global
    Create Function: FUNCTION_MATCH
    Guard Types: ['ID_MATCH']
    Code List: ["___check_obj_id(G['torch'].abs, 139633826918656)"]
    Object Weakref: None
    Guarded Class Weakref: <weakref at 0x7eff0a3c5cb0; to 'type' at 0x564c7ac958a0 (builtin_function_or_method)>
  Guard 2:
    Name: ''
    Source: shape_env
    Create Function: SHAPE_ENV
    Guard Types: None
    Code List: None
    Object Weakref: None
    Guarded Class Weakref: None
  Guard 3:
    Name: "L['b']"
    Source: local
    Create Function: TENSOR_MATCH
    Guard Types: ['TENSOR_MATCH']
    Code List: ["hasattr(L['b'], '_dynamo_dynamic_indices') == False"]
    Object Weakref: <weakref at 0x7efd0c01d120; dead>
    Guarded Class Weakref: <weakref at 0x7efe4b135440; to 'torch._C._TensorMeta' at 0x564ca57e8240 (Tensor)>
  Guard 4:
    Name: ''
    Source: global
    Create Function: TORCH_FUNCTION_STATE
    Guard Types: None
    Code List: None
    Object Weakref: None
    Guarded Class Weakref: None
  Guard 5:
    Name: "G['torch']"
    Source: global
    Create Function: FUNCTION_MATCH
    Guard Types: ['ID_MATCH']
    Code List: ["___check_obj_id(G['torch'], 139633827970192)"]
    Object Weakref: None
    Guarded Class Weakref: <weakref at 0x7eff0a3ef1a0; to 'type' at 0x564c7ac9f0a0 (module)>
  Guard 6:
    Name: ''
    Source: global
    Create Function: DEFAULT_DEVICE
    Guard Types: ['DEFAULT_DEVICE']
    Code List: ['utils_device.CURRENT_DEVICE == None']
    Object Weakref: None
    Guarded Class Weakref: None
  Guard 7:
    Name: "L['a']"
    Source: local
    Create Function: TENSOR_MATCH
    Guard Types: ['TENSOR_MATCH']
    Code List: ["hasattr(L['a'], '_dynamo_dynamic_indices') == False"]
    Object Weakref: <weakref at 0x7efd086da070; dead>
    Guarded Class Weakref: <weakref at 0x7efe4b135440; to 'torch._C._TensorMeta' at 0x564ca57e8240 (Tensor)>
  Guard 8:
    Name: ''
    Source: global
    Create Function: DETERMINISTIC_ALGORITHMS
    Guard Types: None
    Code List: None
    Object Weakref: None
    Guarded Class Weakref: None
  Guard 9:
    Name: ''
    Source: global
    Create Function: GRAD_MODE
    Guard Types: None
    Code List: None
    Object Weakref: None
    Guarded Class Weakref: None
  Guard 10:
    Name: ''
    Source: shape_env
    Create Function: SHAPE_ENV
    Guard Types: None
    Code List: None
    Object Weakref: None
    Guarded Class Weakref: None
  Guard 11:
    Name: "L['b']"
    Source: local
    Create Function: TENSOR_MATCH
    Guard Types: ['TENSOR_MATCH']
    Code List: ["hasattr(L['b'], '_dynamo_dynamic_indices') == False"]
    Object Weakref: <weakref at 0x7efd0c01d120; dead>
    Guarded Class Weakref: <weakref at 0x7efe4b135440; to 'torch._C._TensorMeta' at 0x564ca57e8240 (Tensor)>
  Guard 12:
    Name: ''
    Source: global
    Create Function: TORCH_FUNCTION_STATE
    Guard Types: None
    Code List: None
    Object Weakref: None
    Guarded Class Weakref: None
  Guard 13:
    Name: "L['x']"
    Source: local
    Create Function: TENSOR_MATCH
    Guard Types: ['TENSOR_MATCH']
    Code List: ["hasattr(L['x'], '_dynamo_dynamic_indices') == False"]
    Object Weakref: <weakref at 0x7efd0f288db0; dead>
    Guarded Class Weakref: <weakref at 0x7efe4b135440; to 'torch._C._TensorMeta' at 0x564ca57e8240 (Tensor)>
  Guard 14:
    Name: ''
    Source: global
    Create Function: DEFAULT_DEVICE
    Guard Types: ['DEFAULT_DEVICE']
    Code List: ['utils_device.CURRENT_DEVICE == None']
    Object Weakref: None
    Guarded Class Weakref: None
  Guard 15:
    Name: ''
    Source: global
    Create Function: DETERMINISTIC_ALGORITHMS
    Guard Types: None
    Code List: None
    Object Weakref: None
    Guarded Class Weakref: None
  Guard 16:
    Name: ''
    Source: global
    Create Function: GRAD_MODE
    Guard Types: None
    Code List: None
    Object Weakref: None
    Guarded Class Weakref: None
Compile Times: TorchDynamo compilation metrics:
Function                        Runtimes (s)
------------------------------  --------------
_compile.compile_inner          0.0100, 0.0059
OutputGraph.call_user_compiler  0.0001, 0.0001

In order to maximize speedup, graph breaks should be limited. We can force TorchDynamo to raise an error upon the first graph break encountered by using fullgraph=True:

opt_bar = torch.compile(bar, fullgraph=True)
try:
    opt_bar(torch.randn(10), torch.randn(10))
except:
    tb.print_exc()
Traceback (most recent call last):
  File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 580, in <module>
    opt_bar(torch.randn(10), torch.randn(10))
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/eval_frame.py", line 465, in _fn
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/convert_frame.py", line 1269, in __call__
    return self._torchdynamo_orig_callable(
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/convert_frame.py", line 526, in __call__
    return _compile(
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/convert_frame.py", line 924, in _compile
    guarded_code = compile_inner(code, one_graph, hooks, transform)
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/convert_frame.py", line 666, in compile_inner
    return _compile_inner(code, one_graph, hooks, transform)
  File "/usr/local/lib/python3.10/dist-packages/torch/_utils_internal.py", line 87, in wrapper_function
    return function(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/convert_frame.py", line 699, in _compile_inner
    out_code = transform_code_object(code, transform)
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/bytecode_transformation.py", line 1322, in transform_code_object
    transformations(instructions, code_options)
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/convert_frame.py", line 219, in _fn
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/convert_frame.py", line 634, in transform
    tracer.run()
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/symbolic_convert.py", line 2796, in run
    super().run()
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/symbolic_convert.py", line 983, in run
    while self.step():
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/symbolic_convert.py", line 895, in step
    self.dispatch_table[inst.opcode](self, inst)
  File "/usr/local/lib/python3.10/dist-packages/torch/_dynamo/symbolic_convert.py", line 560, in inner
    raise exc.UserError(
torch._dynamo.exc.UserError: Dynamic control flow is not supported at the moment. Please use functorch.experimental.control_flow.cond to explicitly capture the control flow. For more information about this error, see: https://pytorch.org/docs/main/generated/exportdb/index.html#cond-operands

from user code:
   File "/var/lib/workspace/intermediate_source/torch_compile_tutorial.py", line 532, in bar
    if b.sum() < 0:

Set TORCH_LOGS="+dynamo" and TORCHDYNAMO_VERBOSE=1 for more information


You can suppress this exception and fall back to eager by setting:
    import torch._dynamo
    torch._dynamo.config.suppress_errors = True

And below, we demonstrate that TorchDynamo does not break the graph on the model we used above for demonstrating speedups.

opt_model = torch.compile(init_model(), fullgraph=True)
print(opt_model(generate_data(16)[0]))
tensor([[ 0.1939, -0.1853, -0.0344,  ..., -0.1101, -0.0872, -0.0552],
        [ 0.2228, -0.2526, -0.0481,  ..., -0.1006, -0.0565,  0.0948],
        [ 0.1808, -0.1845,  0.0861,  ..., -0.1822, -0.0491,  0.0786],
        ...,
        [ 0.1161, -0.1850,  0.2043,  ..., -0.1983, -0.0944, -0.0806],
        [-0.0312, -0.2902,  0.0941,  ...,  0.0460, -0.1324,  0.0094],
        [ 0.2577, -0.0612,  0.0880,  ..., -0.0967, -0.0551, -0.0584]],
       device='cuda:0', grad_fn=<CompiledFunctionBackward>)

We can use torch.export (from PyTorch 2.1+) to extract a single, exportable FX graph from the input PyTorch program. The exported graph is intended to be run on different (i.e. Python-less) environments. One important restriction is that the torch.export does not support graph breaks. Please check this tutorial for more details on torch.export.

Conclusion

In this tutorial, we introduced torch.compile by covering basic usage, demonstrating speedups over eager mode, comparing to previous PyTorch compiler solutions, and briefly investigating TorchDynamo and its interactions with FX graphs. We hope that you will give torch.compile a try!

Total running time of the script: ( 6 minutes 53.582 seconds)

Gallery generated by Sphinx-Gallery

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources