Hyperparameter tuning with Ray Tune

Hyperparameter tuning can make the difference between an average model and a highly accurate one. Often simple things like choosing a different learning rate or changing a network layer size can have a dramatic impact on your model performance.

Fortunately, there are tools that help with finding the best combination of parameters. Ray Tune is an industry standard tool for distributed hyperparameter tuning. Ray Tune includes the latest hyperparameter search algorithms, integrates with TensorBoard and other analysis libraries, and natively supports distributed training through Ray’s distributed machine learning engine.

In this tutorial, we will show you how to integrate Ray Tune into your PyTorch training workflow. We will extend this tutorial from the PyTorch documentation for training a CIFAR10 image classifier.

As you will see, we only need to add some slight modifications. In particular, we need to

1. wrap data loading and training in functions,

2. make some network parameters configurable,

3. add checkpointing (optional),

4. and define the search space for the model tuning

To run this tutorial, please make sure the following packages are installed:

• ray[tune]: Distributed hyperparameter tuning library

• torchvision: For the data transformers

Setup / Imports

Let’s start with the imports:

from functools import partial
import numpy as np
import os
import torch
import torch.nn as nn
import torch.nn.functional as F
import torch.optim as optim
from torch.utils.data import random_split
import torchvision
import torchvision.transforms as transforms
from ray import tune
from ray.tune import CLIReporter
from ray.tune.schedulers import ASHAScheduler

Most of the imports are needed for building the PyTorch model. Only the last three imports are for Ray Tune.

Data loaders

We wrap the data loaders in their own function and pass a global data directory. This way we can share a data directory between different trials.

def load_data(data_dir="./data"):
    transform = transforms.Compose([
        transforms.ToTensor(),
        transforms.Normalize((0.5, 0.5, 0.5), (0.5, 0.5, 0.5))
    ])

    trainset = torchvision.datasets.CIFAR10(
        root=data_dir, train=True, download=True, transform=transform)

    testset = torchvision.datasets.CIFAR10(
        root=data_dir, train=False, download=True, transform=transform)

    return trainset, testset

Configurable neural network

We can only tune those parameters that are configurable. In this example, we can specify the layer sizes of the fully connected layers:

class Net(nn.Module):
    def __init__(self, l1=120, l2=84):
        super(Net, self).__init__()
        self.conv1 = nn.Conv2d(3, 6, 5)
        self.pool = nn.MaxPool2d(2, 2)
        self.conv2 = nn.Conv2d(6, 16, 5)
        self.fc1 = nn.Linear(16 * 5 * 5, l1)
        self.fc2 = nn.Linear(l1, l2)
        self.fc3 = nn.Linear(l2, 10)

    def forward(self, x):
        x = self.pool(F.relu(self.conv1(x)))
        x = self.pool(F.relu(self.conv2(x)))
        x = x.view(-1, 16 * 5 * 5)
        x = F.relu(self.fc1(x))
        x = F.relu(self.fc2(x))
        x = self.fc3(x)
        return x

The train function

Now it gets interesting, because we introduce some changes to the example from the PyTorch documentation.

We wrap the training script in a function train_cifar(config, checkpoint_dir=None, data_dir=None). As you can guess, the config parameter will receive the hyperparameters we would like to train with. The checkpoint_dir parameter is used to restore checkpoints. The data_dir specifies the directory where we load and store the data, so multiple runs can share the same data source.

net = Net(config["l1"], config["l2"])

if checkpoint_dir:
    model_state, optimizer_state = torch.load(
        os.path.join(checkpoint_dir, "checkpoint"))
    net.load_state_dict(model_state)
    optimizer.load_state_dict(optimizer_state)

The learning rate of the optimizer is made configurable, too:

optimizer = optim.SGD(net.parameters(), lr=config["lr"], momentum=0.9)

We also split the training data into a training and validation subset. We thus train on 80% of the data and calculate the validation loss on the remaining 20%. The batch sizes with which we iterate through the training and test sets are configurable as well.

Adding (multi) GPU support with DataParallel

Image classification benefits largely from GPUs. Luckily, we can continue to use PyTorch’s abstractions in Ray Tune. Thus, we can wrap our model in nn.DataParallel to support data parallel training on multiple GPUs:

device = "cpu"
if torch.cuda.is_available():
    device = "cuda:0"
    if torch.cuda.device_count() > 1:
        net = nn.DataParallel(net)
net.to(device)

By using a device variable we make sure that training also works when we have no GPUs available. PyTorch requires us to send our data to the GPU memory explicitly, like this:

for i, data in enumerate(trainloader, 0):
    inputs, labels = data
    inputs, labels = inputs.to(device), labels.to(device)

The code now supports training on CPUs, on a single GPU, and on multiple GPUs. Notably, Ray also supports fractional GPUs so we can share GPUs among trials, as long as the model still fits on the GPU memory. We’ll come back to that later.

Communicating with Ray Tune

The most interesting part is the communication with Ray Tune:

with tune.checkpoint_dir(epoch) as checkpoint_dir:
    path = os.path.join(checkpoint_dir, "checkpoint")
    torch.save((net.state_dict(), optimizer.state_dict()), path)

tune.report(loss=(val_loss / val_steps), accuracy=correct / total)

Here we first save a checkpoint and then report some metrics back to Ray Tune. Specifically, we send the validation loss and accuracy back to Ray Tune. Ray Tune can then use these metrics to decide which hyperparameter configuration lead to the best results. These metrics can also be used to stop bad performing trials early in order to avoid wasting resources on those trials.

The checkpoint saving is optional, however, it is necessary if we wanted to use advanced schedulers like Population Based Training. Also, by saving the checkpoint we can later load the trained models and validate them on a test set.

Full training function

The full code example looks like this:

def train_cifar(config, checkpoint_dir=None, data_dir=None):
    net = Net(config["l1"], config["l2"])

    device = "cpu"
    if torch.cuda.is_available():
        device = "cuda:0"
        if torch.cuda.device_count() > 1:
            net = nn.DataParallel(net)
    net.to(device)

    criterion = nn.CrossEntropyLoss()
    optimizer = optim.SGD(net.parameters(), lr=config["lr"], momentum=0.9)

    if checkpoint_dir:
        model_state, optimizer_state = torch.load(
            os.path.join(checkpoint_dir, "checkpoint"))
        net.load_state_dict(model_state)
        optimizer.load_state_dict(optimizer_state)

    trainset, testset = load_data(data_dir)

    test_abs = int(len(trainset) * 0.8)
    train_subset, val_subset = random_split(
        trainset, [test_abs, len(trainset) - test_abs])

    trainloader = torch.utils.data.DataLoader(
        train_subset,
        batch_size=int(config["batch_size"]),
        shuffle=True,
        num_workers=8)
    valloader = torch.utils.data.DataLoader(
        val_subset,
        batch_size=int(config["batch_size"]),
        shuffle=True,
        num_workers=8)

    for epoch in range(10):  # loop over the dataset multiple times
        running_loss = 0.0
        epoch_steps = 0
        for i, data in enumerate(trainloader, 0):
            # get the inputs; data is a list of [inputs, labels]
            inputs, labels = data
            inputs, labels = inputs.to(device), labels.to(device)

            # zero the parameter gradients
            optimizer.zero_grad()

            # forward + backward + optimize
            outputs = net(inputs)
            loss = criterion(outputs, labels)
            loss.backward()
            optimizer.step()

            # print statistics
            running_loss += loss.item()
            epoch_steps += 1
            if i % 2000 == 1999:  # print every 2000 mini-batches
                print("[%d, %5d] loss: %.3f" % (epoch + 1, i + 1,
                                                running_loss / epoch_steps))
                running_loss = 0.0

        # Validation loss
        val_loss = 0.0
        val_steps = 0
        total = 0
        correct = 0
        for i, data in enumerate(valloader, 0):
            with torch.no_grad():
                inputs, labels = data
                inputs, labels = inputs.to(device), labels.to(device)

                outputs = net(inputs)
                _, predicted = torch.max(outputs.data, 1)
                total += labels.size(0)
                correct += (predicted == labels).sum().item()

                loss = criterion(outputs, labels)
                val_loss += loss.cpu().numpy()
                val_steps += 1

        with tune.checkpoint_dir(epoch) as checkpoint_dir:
            path = os.path.join(checkpoint_dir, "checkpoint")
            torch.save((net.state_dict(), optimizer.state_dict()), path)

        tune.report(loss=(val_loss / val_steps), accuracy=correct / total)
    print("Finished Training")

As you can see, most of the code is adapted directly from the original example.

Test set accuracy

Commonly the performance of a machine learning model is tested on a hold-out test set with data that has not been used for training the model. We also wrap this in a function:

def test_accuracy(net, device="cpu"):
    trainset, testset = load_data()

    testloader = torch.utils.data.DataLoader(
        testset, batch_size=4, shuffle=False, num_workers=2)

    correct = 0
    total = 0
    with torch.no_grad():
        for data in testloader:
            images, labels = data
            images, labels = images.to(device), labels.to(device)
            outputs = net(images)
            _, predicted = torch.max(outputs.data, 1)
            total += labels.size(0)
            correct += (predicted == labels).sum().item()

    return correct / total

The function also expects a device parameter, so we can do the test set validation on a GPU.

Configuring the search space

Lastly, we need to define Ray Tune’s search space. Here is an example:

config = {
    "l1": tune.sample_from(lambda _: 2**np.random.randint(2, 9)),
    "l2": tune.sample_from(lambda _: 2**np.random.randint(2, 9)),
    "lr": tune.loguniform(1e-4, 1e-1),
    "batch_size": tune.choice([2, 4, 8, 16])
}

The tune.sample_from() function makes it possible to define your own sample methods to obtain hyperparameters. In this example, the l1 and l2 parameters should be powers of 2 between 4 and 256, so either 4, 8, 16, 32, 64, 128, or 256. The lr (learning rate) should be uniformly sampled between 0.0001 and 0.1. Lastly, the batch size is a choice between 2, 4, 8, and 16.

At each trial, Ray Tune will now randomly sample a combination of parameters from these search spaces. It will then train a number of models in parallel and find the best performing one among these. We also use the ASHAScheduler which will terminate bad performing trials early.

We wrap the train_cifar function with functools.partial to set the constant data_dir parameter. We can also tell Ray Tune what resources should be available for each trial:

gpus_per_trial = 2
# ...
result = tune.run(
    partial(train_cifar, data_dir=data_dir),
    resources_per_trial={"cpu": 8, "gpu": gpus_per_trial},
    config=config,
    num_samples=num_samples,
    scheduler=scheduler,
    progress_reporter=reporter,
    checkpoint_at_end=True)

You can specify the number of CPUs, which are then available e.g. to increase the num_workers of the PyTorch DataLoader instances. The selected number of GPUs are made visible to PyTorch in each trial. Trials do not have access to GPUs that haven’t been requested for them - so you don’t have to care about two trials using the same set of resources.

Here we can also specify fractional GPUs, so something like gpus_per_trial=0.5 is completely valid. The trials will then share GPUs among each other. You just have to make sure that the models still fit in the GPU memory.

After training the models, we will find the best performing one and load the trained network from the checkpoint file. We then obtain the test set accuracy and report everything by printing.

The full main function looks like this:

def main(num_samples=10, max_num_epochs=10, gpus_per_trial=2):
    data_dir = os.path.abspath("./data")
    load_data(data_dir)
    config = {
        "l1": tune.sample_from(lambda _: 2 ** np.random.randint(2, 9)),
        "l2": tune.sample_from(lambda _: 2 ** np.random.randint(2, 9)),
        "lr": tune.loguniform(1e-4, 1e-1),
        "batch_size": tune.choice([2, 4, 8, 16])
    }
    scheduler = ASHAScheduler(
        metric="loss",
        mode="min",
        max_t=max_num_epochs,
        grace_period=1,
        reduction_factor=2)
    reporter = CLIReporter(
        # parameter_columns=["l1", "l2", "lr", "batch_size"],
        metric_columns=["loss", "accuracy", "training_iteration"])
    result = tune.run(
        partial(train_cifar, data_dir=data_dir),
        resources_per_trial={"cpu": 2, "gpu": gpus_per_trial},
        config=config,
        num_samples=num_samples,
        scheduler=scheduler,
        progress_reporter=reporter)

    best_trial = result.get_best_trial("loss", "min", "last")
    print("Best trial config: {}".format(best_trial.config))
    print("Best trial final validation loss: {}".format(
        best_trial.last_result["loss"]))
    print("Best trial final validation accuracy: {}".format(
        best_trial.last_result["accuracy"]))

    best_trained_model = Net(best_trial.config["l1"], best_trial.config["l2"])
    device = "cpu"
    if torch.cuda.is_available():
        device = "cuda:0"
        if gpus_per_trial > 1:
            best_trained_model = nn.DataParallel(best_trained_model)
    best_trained_model.to(device)

    best_checkpoint_dir = best_trial.checkpoint.value
    model_state, optimizer_state = torch.load(os.path.join(
        best_checkpoint_dir, "checkpoint"))
    best_trained_model.load_state_dict(model_state)

    test_acc = test_accuracy(best_trained_model, device)
    print("Best trial test set accuracy: {}".format(test_acc))


if __name__ == "__main__":
    # You can change the number of GPUs per trial here:
    main(num_samples=10, max_num_epochs=10, gpus_per_trial=0)

Out:

Downloading https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz to /var/lib/jenkins/workspace/beginner_source/data/cifar-10-python.tar.gz
Extracting /var/lib/jenkins/workspace/beginner_source/data/cifar-10-python.tar.gz to /var/lib/jenkins/workspace/beginner_source/data
Files already downloaded and verified
== Status ==
Current time: 2022-08-29 15:49:22 (running for 00:00:00.36)
Memory usage on this node: 1.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (9 PENDING, 1 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |
|-------------------------+----------+-----------------+--------------+------+------+-------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |
| train_cifar_26514_00001 | PENDING  |                 |            8 |  128 |    8 | 0.000151196 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |
+-------------------------+----------+-----------------+--------------+------+------+-------------+


(func pid=1624) Files already downloaded and verified
(func pid=1624) Files already downloaded and verified
(func pid=1658) Files already downloaded and verified
== Status ==
Current time: 2022-08-29 15:49:30 (running for 00:00:08.15)
Memory usage on this node: 2.6/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |
|-------------------------+----------+-----------------+--------------+------+------+-------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |
+-------------------------+----------+-----------------+--------------+------+------+-------------+

(func pid=1658) Files already downloaded and verified

== Status ==
Current time: 2022-08-29 15:49:35 (running for 00:00:13.18)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |
|-------------------------+----------+-----------------+--------------+------+------+-------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |
+-------------------------+----------+-----------------+--------------+------+------+-------------+


(func pid=1624) [1,  2000] loss: 2.315
== Status ==
Current time: 2022-08-29 15:49:40 (running for 00:00:18.19)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |
|-------------------------+----------+-----------------+--------------+------+------+-------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |
+-------------------------+----------+-----------------+--------------+------+------+-------------+


(func pid=1658) [1,  2000] loss: 2.318
== Status ==
Current time: 2022-08-29 15:49:45 (running for 00:00:23.29)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |
|-------------------------+----------+-----------------+--------------+------+------+-------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |
+-------------------------+----------+-----------------+--------------+------+------+-------------+


(func pid=1624) [1,  4000] loss: 1.091
== Status ==
Current time: 2022-08-29 15:49:50 (running for 00:00:28.31)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |
|-------------------------+----------+-----------------+--------------+------+------+-------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |
+-------------------------+----------+-----------------+--------------+------+------+-------------+


== Status ==
Current time: 2022-08-29 15:49:55 (running for 00:00:33.33)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |
|-------------------------+----------+-----------------+--------------+------+------+-------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |
+-------------------------+----------+-----------------+--------------+------+------+-------------+


(func pid=1658) [1,  4000] loss: 1.155
== Status ==
Current time: 2022-08-29 15:50:00 (running for 00:00:38.36)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |
|-------------------------+----------+-----------------+--------------+------+------+-------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |
+-------------------------+----------+-----------------+--------------+------+------+-------------+


(func pid=1624) [1,  6000] loss: 0.669
== Status ==
Current time: 2022-08-29 15:50:05 (running for 00:00:43.38)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |
|-------------------------+----------+-----------------+--------------+------+------+-------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |
+-------------------------+----------+-----------------+--------------+------+------+-------------+


Result for train_cifar_26514_00001:
  accuracy: 0.1421
  date: 2022-08-29_15-50-10
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 1
  loss: 2.302865869140625
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 41.69343328475952
  time_this_iter_s: 41.69343328475952
  time_total_s: 41.69343328475952
  timestamp: 1661788210
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '26514_00001'
  warmup_time: 0.0053937435150146484

(func pid=1624) [1,  8000] loss: 0.478
== Status ==
Current time: 2022-08-29 15:50:15 (running for 00:00:53.08)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -2.302865869140625
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |         |            |                      |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.30287 |     0.1421 |                    1 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:50:20 (running for 00:00:58.11)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -2.302865869140625
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |         |            |                      |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.30287 |     0.1421 |                    1 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [2,  2000] loss: 2.301
(func pid=1624) [1, 10000] loss: 0.360
== Status ==
Current time: 2022-08-29 15:50:25 (running for 00:01:03.14)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -2.302865869140625
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |         |            |                      |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.30287 |     0.1421 |                    1 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:50:30 (running for 00:01:08.18)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -2.302865869140625
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 |         |            |                      |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.30287 |     0.1421 |                    1 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00000:
  accuracy: 0.308
  date: 2022-08-29_15-50-34
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 1
  loss: 1.7745955499887467
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 69.5168707370758
  time_this_iter_s: 69.5168707370758
  time_total_s: 69.5168707370758
  timestamp: 1661788234
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '26514_00000'
  warmup_time: 0.003681182861328125

(func pid=1658) [2,  4000] loss: 1.144
== Status ==
Current time: 2022-08-29 15:50:39 (running for 00:01:17.67)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |     0.308  |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.30287 |     0.1421 |                    1 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:50:44 (running for 00:01:22.71)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |     0.308  |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.30287 |     0.1421 |                    1 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [2,  2000] loss: 1.740
== Status ==
Current time: 2022-08-29 15:50:49 (running for 00:01:27.73)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |     0.308  |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.30287 |     0.1421 |                    1 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00001:
  accuracy: 0.1556
  date: 2022-08-29_15-50-51
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 2
  loss: 2.248111947917938
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 82.54844760894775
  time_this_iter_s: 40.85501432418823
  time_total_s: 82.54844760894775
  timestamp: 1661788251
  timesteps_since_restore: 0
  training_iteration: 2
  trial_id: '26514_00001'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 15:50:56 (running for 00:01:33.96)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -2.248111947917938 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |     0.308  |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.24811 |     0.1556 |                    2 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [2,  4000] loss: 0.846
== Status ==
Current time: 2022-08-29 15:51:01 (running for 00:01:38.97)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -2.248111947917938 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |     0.308  |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.24811 |     0.1556 |                    2 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3,  2000] loss: 2.224
== Status ==
Current time: 2022-08-29 15:51:06 (running for 00:01:44.00)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -2.248111947917938 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |     0.308  |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.24811 |     0.1556 |                    2 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [2,  6000] loss: 0.546
== Status ==
Current time: 2022-08-29 15:51:11 (running for 00:01:49.01)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -2.248111947917938 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |     0.308  |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.24811 |     0.1556 |                    2 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:51:16 (running for 00:01:54.03)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -2.248111947917938 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |     0.308  |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.24811 |     0.1556 |                    2 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3,  4000] loss: 1.079
== Status ==
Current time: 2022-08-29 15:51:21 (running for 00:01:59.06)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -2.248111947917938 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |     0.308  |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.24811 |     0.1556 |                    2 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [2,  8000] loss: 0.401
== Status ==
Current time: 2022-08-29 15:51:26 (running for 00:02:04.09)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -2.248111947917938 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |     0.308  |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.24811 |     0.1556 |                    2 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00001:
  accuracy: 0.255
  date: 2022-08-29_15-51-31
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 3
  loss: 2.084764797115326
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 122.60260915756226
  time_this_iter_s: 40.0541615486145
  time_total_s: 122.60260915756226
  timestamp: 1661788291
  timesteps_since_restore: 0
  training_iteration: 3
  trial_id: '26514_00001'
  warmup_time: 0.0053937435150146484

(func pid=1624) [2, 10000] loss: 0.317
== Status ==
Current time: 2022-08-29 15:51:36 (running for 00:02:13.99)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -2.248111947917938 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |      0.308 |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.08476 |      0.255 |                    3 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:51:41 (running for 00:02:19.03)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -2.248111947917938 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.7746  |      0.308 |                    1 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.08476 |      0.255 |                    3 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00000:
  accuracy: 0.4367
  date: 2022-08-29_15-51-43
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 2
  loss: 1.5174541333079339
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 138.00173044204712
  time_this_iter_s: 68.48485970497131
  time_total_s: 138.00173044204712
  timestamp: 1661788303
  timesteps_since_restore: 0
  training_iteration: 2
  trial_id: '26514_00000'
  warmup_time: 0.003681182861328125

(func pid=1658) [4,  2000] loss: 2.042
== Status ==
Current time: 2022-08-29 15:51:48 (running for 00:02:26.16)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.08476 |     0.255  |                    3 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:51:53 (running for 00:02:31.19)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.08476 |     0.255  |                    3 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [3,  2000] loss: 1.530
== Status ==
Current time: 2022-08-29 15:51:58 (running for 00:02:36.21)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.08476 |     0.255  |                    3 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4,  4000] loss: 0.985
== Status ==
Current time: 2022-08-29 15:52:03 (running for 00:02:41.22)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.08476 |     0.255  |                    3 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [3,  4000] loss: 0.750
== Status ==
Current time: 2022-08-29 15:52:08 (running for 00:02:46.25)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 2.08476 |     0.255  |                    3 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00001:
  accuracy: 0.3093
  date: 2022-08-29_15-52-11
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 4
  loss: 1.9242985949516296
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 162.91350936889648
  time_this_iter_s: 40.31090021133423
  time_total_s: 162.91350936889648
  timestamp: 1661788331
  timesteps_since_restore: 0
  training_iteration: 4
  trial_id: '26514_00001'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 15:52:16 (running for 00:02:54.31)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.9243  |     0.3093 |                    4 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [3,  6000] loss: 0.494
== Status ==
Current time: 2022-08-29 15:52:21 (running for 00:02:59.33)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.9243  |     0.3093 |                    4 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5,  2000] loss: 1.885
== Status ==
Current time: 2022-08-29 15:52:26 (running for 00:03:04.37)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.9243  |     0.3093 |                    4 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [3,  8000] loss: 0.363
== Status ==
Current time: 2022-08-29 15:52:31 (running for 00:03:09.40)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.9243  |     0.3093 |                    4 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:52:36 (running for 00:03:14.43)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.9243  |     0.3093 |                    4 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5,  4000] loss: 0.902
(func pid=1624) [3, 10000] loss: 0.285
== Status ==
Current time: 2022-08-29 15:52:41 (running for 00:03:19.46)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.9243  |     0.3093 |                    4 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:52:46 (running for 00:03:24.49)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.51745 |     0.4367 |                    2 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.9243  |     0.3093 |                    4 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00000:
  accuracy: 0.4693
  date: 2022-08-29_15-52-51
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 3
  loss: 1.4389388314962388
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 205.78484201431274
  time_this_iter_s: 67.78311157226562
  time_total_s: 205.78484201431274
  timestamp: 1661788371
  timesteps_since_restore: 0
  training_iteration: 3
  trial_id: '26514_00000'
  warmup_time: 0.003681182861328125

Result for train_cifar_26514_00001:
  accuracy: 0.3605
  date: 2022-08-29_15-52-52
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 5
  loss: 1.741312026119232
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 203.50352311134338
  time_this_iter_s: 40.5900137424469
  time_total_s: 203.50352311134338
  timestamp: 1661788372
  timesteps_since_restore: 0
  training_iteration: 5
  trial_id: '26514_00001'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 15:52:52 (running for 00:03:29.89)
Memory usage on this node: 2.6/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.74131 |     0.3605 |                    5 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:52:57 (running for 00:03:34.92)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.74131 |     0.3605 |                    5 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:53:02 (running for 00:03:39.94)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.74131 |     0.3605 |                    5 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [4,  2000] loss: 1.404
(func pid=1658) [6,  2000] loss: 1.706
== Status ==
Current time: 2022-08-29 15:53:07 (running for 00:03:44.96)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.74131 |     0.3605 |                    5 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:53:12 (running for 00:03:49.97)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.74131 |     0.3605 |                    5 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [4,  4000] loss: 0.690
== Status ==
Current time: 2022-08-29 15:53:17 (running for 00:03:55.00)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.74131 |     0.3605 |                    5 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6,  4000] loss: 0.829
== Status ==
Current time: 2022-08-29 15:53:22 (running for 00:04:00.02)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.74131 |     0.3605 |                    5 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [4,  6000] loss: 0.457
== Status ==
Current time: 2022-08-29 15:53:27 (running for 00:04:05.04)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.74131 |     0.3605 |                    5 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00001:
  accuracy: 0.4037
  date: 2022-08-29_15-53-31
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 6
  loss: 1.6382201398849487
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 242.97171211242676
  time_this_iter_s: 39.468189001083374
  time_total_s: 242.97171211242676
  timestamp: 1661788411
  timesteps_since_restore: 0
  training_iteration: 6
  trial_id: '26514_00001'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 15:53:36 (running for 00:04:14.36)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.63822 |     0.4037 |                    6 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+

(func pid=1624) [4,  8000] loss: 0.338

== Status ==
Current time: 2022-08-29 15:53:41 (running for 00:04:19.39)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.63822 |     0.4037 |                    6 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7,  2000] loss: 1.607
== Status ==
Current time: 2022-08-29 15:53:46 (running for 00:04:24.42)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.63822 |     0.4037 |                    6 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [4, 10000] loss: 0.269
== Status ==
Current time: 2022-08-29 15:53:51 (running for 00:04:29.43)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.63822 |     0.4037 |                    6 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:53:56 (running for 00:04:34.45)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.9242985949516296 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.43894 |     0.4693 |                    3 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.63822 |     0.4037 |                    6 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00000:
  accuracy: 0.524
  date: 2022-08-29_15-53-57
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 4
  loss: 1.3274063286542892
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 272.3220646381378
  time_this_iter_s: 66.53722262382507
  time_total_s: 272.3220646381378
  timestamp: 1661788437
  timesteps_since_restore: 0
  training_iteration: 4
  trial_id: '26514_00000'
  warmup_time: 0.003681182861328125

(func pid=1658) [7,  4000] loss: 0.792
== Status ==
Current time: 2022-08-29 15:54:02 (running for 00:04:40.49)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.63822 |     0.4037 |                    6 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:54:07 (running for 00:04:45.50)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.63822 |     0.4037 |                    6 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [5,  2000] loss: 1.289
Result for train_cifar_26514_00001:
  accuracy: 0.4214
  date: 2022-08-29_15-54-11
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 7
  loss: 1.5875390249729155
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 283.21664810180664
  time_this_iter_s: 40.24493598937988
  time_total_s: 283.21664810180664
  timestamp: 1661788451
  timesteps_since_restore: 0
  training_iteration: 7
  trial_id: '26514_00001'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 15:54:16 (running for 00:04:54.61)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.58754 |     0.4214 |                    7 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [5,  4000] loss: 0.646
== Status ==
Current time: 2022-08-29 15:54:21 (running for 00:04:59.63)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.58754 |     0.4214 |                    7 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8,  2000] loss: 1.548
== Status ==
Current time: 2022-08-29 15:54:26 (running for 00:05:04.66)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.58754 |     0.4214 |                    7 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:54:31 (running for 00:05:09.68)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.58754 |     0.4214 |                    7 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [5,  6000] loss: 0.436
== Status ==
Current time: 2022-08-29 15:54:36 (running for 00:05:14.71)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.58754 |     0.4214 |                    7 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8,  4000] loss: 0.764
== Status ==
Current time: 2022-08-29 15:54:41 (running for 00:05:19.72)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.58754 |     0.4214 |                    7 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [5,  8000] loss: 0.318
== Status ==
Current time: 2022-08-29 15:54:46 (running for 00:05:24.74)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.58754 |     0.4214 |                    7 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00001:
  accuracy: 0.4524
  date: 2022-08-29_15-54-51
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 8
  loss: 1.508380093717575
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 323.0486538410187
  time_this_iter_s: 39.832005739212036
  time_total_s: 323.0486538410187
  timestamp: 1661788491
  timesteps_since_restore: 0
  training_iteration: 8
  trial_id: '26514_00001'
  warmup_time: 0.0053937435150146484

(func pid=1624) [5, 10000] loss: 0.254
== Status ==
Current time: 2022-08-29 15:54:56 (running for 00:05:34.45)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.50838 |     0.4524 |                    8 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:55:01 (running for 00:05:39.49)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.32741 |     0.524  |                    4 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.50838 |     0.4524 |                    8 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00000:
  accuracy: 0.53
  date: 2022-08-29_15-55-05
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 5
  loss: 1.307050661855936
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 340.12657356262207
  time_this_iter_s: 67.80450892448425
  time_total_s: 340.12657356262207
  timestamp: 1661788505
  timesteps_since_restore: 0
  training_iteration: 5
  trial_id: '26514_00000'
  warmup_time: 0.003681182861328125

(func pid=1658) [9,  2000] loss: 1.492
== Status ==
Current time: 2022-08-29 15:55:10 (running for 00:05:48.28)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.50838 |     0.4524 |                    8 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:55:15 (running for 00:05:53.32)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.50838 |     0.4524 |                    8 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [6,  2000] loss: 1.238
(func pid=1658) [9,  4000] loss: 0.739
== Status ==
Current time: 2022-08-29 15:55:20 (running for 00:05:58.34)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.50838 |     0.4524 |                    8 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:55:25 (running for 00:06:03.36)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.50838 |     0.4524 |                    8 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [6,  4000] loss: 0.610
== Status ==
Current time: 2022-08-29 15:55:30 (running for 00:06:08.37)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.50838 |     0.4524 |                    8 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00001:
  accuracy: 0.4739
  date: 2022-08-29_15-55-32
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 9
  loss: 1.4678424755334853
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 363.5377070903778
  time_this_iter_s: 40.48905324935913
  time_total_s: 363.5377070903778
  timestamp: 1661788532
  timesteps_since_restore: 0
  training_iteration: 9
  trial_id: '26514_00001'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 15:55:37 (running for 00:06:14.94)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.46784 |     0.4739 |                    9 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [6,  6000] loss: 0.405
== Status ==
Current time: 2022-08-29 15:55:42 (running for 00:06:19.96)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.46784 |     0.4739 |                    9 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10,  2000] loss: 1.446
== Status ==
Current time: 2022-08-29 15:55:47 (running for 00:06:24.99)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.46784 |     0.4739 |                    9 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [6,  8000] loss: 0.307
== Status ==
Current time: 2022-08-29 15:55:52 (running for 00:06:30.01)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.46784 |     0.4739 |                    9 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:55:57 (running for 00:06:35.04)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.46784 |     0.4739 |                    9 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10,  4000] loss: 0.716
== Status ==
Current time: 2022-08-29 15:56:02 (running for 00:06:40.07)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.46784 |     0.4739 |                    9 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [6, 10000] loss: 0.247
== Status ==
Current time: 2022-08-29 15:56:07 (running for 00:06:45.09)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.46784 |     0.4739 |                    9 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:56:12 (running for 00:06:50.12)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (8 PENDING, 2 RUNNING)
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status   | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING  | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.30705 |     0.53   |                    5 |
| train_cifar_26514_00001 | RUNNING  | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.46784 |     0.4739 |                    9 |
| train_cifar_26514_00002 | PENDING  |                 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING  |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING  |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING  |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING  |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING  |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING  |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING  |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
+-------------------------+----------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00001:
  accuracy: 0.4799
  date: 2022-08-29_15-56-12
  done: true
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 10
  loss: 1.4314878283500672
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 404.3413906097412
  time_this_iter_s: 40.8036835193634
  time_total_s: 404.3413906097412
  timestamp: 1661788572
  timesteps_since_restore: 0
  training_iteration: 10
  trial_id: '26514_00001'
  warmup_time: 0.0053937435150146484

(func pid=1658) Files already downloaded and verified
Result for train_cifar_26514_00000:
  accuracy: 0.5455
  date: 2022-08-29_15-56-13
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 6
  loss: 1.262850860145688
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 408.3985130786896
  time_this_iter_s: 68.2719395160675
  time_total_s: 408.3985130786896
  timestamp: 1661788573
  timesteps_since_restore: 0
  training_iteration: 6
  trial_id: '26514_00000'
  warmup_time: 0.003681182861328125

(func pid=1658) Files already downloaded and verified
== Status ==
Current time: 2022-08-29 15:56:18 (running for 00:06:56.58)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:56:23 (running for 00:07:01.60)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [7,  2000] loss: 1.164
(func pid=1658) [1,  2000] loss: 2.318
== Status ==
Current time: 2022-08-29 15:56:28 (running for 00:07:06.62)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:56:33 (running for 00:07:11.64)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [7,  4000] loss: 0.589
(func pid=1658) [1,  4000] loss: 1.160
== Status ==
Current time: 2022-08-29 15:56:38 (running for 00:07:16.66)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:56:43 (running for 00:07:21.68)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [7,  6000] loss: 0.399
(func pid=1658) [1,  6000] loss: 0.774
== Status ==
Current time: 2022-08-29 15:56:48 (running for 00:07:26.70)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:56:53 (running for 00:07:31.73)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [7,  8000] loss: 0.298
== Status ==
Current time: 2022-08-29 15:56:58 (running for 00:07:36.76)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1,  8000] loss: 0.580
== Status ==
Current time: 2022-08-29 15:57:03 (running for 00:07:41.79)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [7, 10000] loss: 0.234
== Status ==
Current time: 2022-08-29 15:57:08 (running for 00:07:46.82)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1, 10000] loss: 0.465
== Status ==
Current time: 2022-08-29 15:57:14 (running for 00:07:51.85)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=1
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.038730709564686
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.26285 |     0.5455 |                    6 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   |         |            |                      |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00000:
  accuracy: 0.5545
  date: 2022-08-29_15-57-17
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 7
  loss: 1.2413796038150788
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 472.5978603363037
  time_this_iter_s: 64.19934725761414
  time_total_s: 472.5978603363037
  timestamp: 1661788637
  timesteps_since_restore: 0
  training_iteration: 7
  trial_id: '26514_00000'
  warmup_time: 0.003681182861328125

Result for train_cifar_26514_00002:
  accuracy: 0.1004
  date: 2022-08-29_15-57-21
  done: true
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 1
  loss: 2.31799423866272
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 68.8598461151123
  time_this_iter_s: 68.8598461151123
  time_total_s: 68.8598461151123
  timestamp: 1661788641
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '26514_00002'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 15:57:21 (running for 00:07:59.67)
Memory usage on this node: 2.6/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.302865869140625
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (7 PENDING, 2 RUNNING, 1 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00002 | RUNNING    | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | PENDING    |                 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) Files already downloaded and verified
(func pid=1658) Files already downloaded and verified
== Status ==
Current time: 2022-08-29 15:57:26 (running for 00:08:04.70)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.302865869140625
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (6 PENDING, 2 RUNNING, 2 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00003 | RUNNING    | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [8,  2000] loss: 1.111
== Status ==
Current time: 2022-08-29 15:57:31 (running for 00:08:09.74)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.302865869140625
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (6 PENDING, 2 RUNNING, 2 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00003 | RUNNING    | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:57:36 (running for 00:08:14.76)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.302865869140625
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (6 PENDING, 2 RUNNING, 2 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00003 | RUNNING    | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1,  2000] loss: 2.063
(func pid=1624) [8,  4000] loss: 0.571
== Status ==
Current time: 2022-08-29 15:57:41 (running for 00:08:19.78)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.302865869140625
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (6 PENDING, 2 RUNNING, 2 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00003 | RUNNING    | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:57:46 (running for 00:08:24.80)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.302865869140625
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (6 PENDING, 2 RUNNING, 2 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00003 | RUNNING    | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   |         |            |                      |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00003:
  accuracy: 0.1831
  date: 2022-08-29_15-57-50
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 1
  loss: 2.1382906749725343
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 28.344741582870483
  time_this_iter_s: 28.344741582870483
  time_total_s: 28.344741582870483
  timestamp: 1661788670
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '26514_00003'
  warmup_time: 0.0053937435150146484

(func pid=1624) [8,  6000] loss: 0.382
== Status ==
Current time: 2022-08-29 15:57:55 (running for 00:08:33.07)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.2205782720565796
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (6 PENDING, 2 RUNNING, 2 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00003 | RUNNING    | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.13829 |     0.1831 |                    1 |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:58:00 (running for 00:08:38.11)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.2205782720565796
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (6 PENDING, 2 RUNNING, 2 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00003 | RUNNING    | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.13829 |     0.1831 |                    1 |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:58:05 (running for 00:08:43.14)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.2205782720565796
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (6 PENDING, 2 RUNNING, 2 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00003 | RUNNING    | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.13829 |     0.1831 |                    1 |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [8,  8000] loss: 0.289
(func pid=1658) [2,  2000] loss: 2.128
== Status ==
Current time: 2022-08-29 15:58:10 (running for 00:08:48.16)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.2205782720565796
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (6 PENDING, 2 RUNNING, 2 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00003 | RUNNING    | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.13829 |     0.1831 |                    1 |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:58:15 (running for 00:08:53.22)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -1.882783040612936 | Iter 1.000: -2.2205782720565796
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (6 PENDING, 2 RUNNING, 2 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00003 | RUNNING    | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.13829 |     0.1831 |                    1 |
| train_cifar_26514_00004 | PENDING    |                 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00003:
  accuracy: 0.197
  date: 2022-08-29_15-58-16
  done: true
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 2
  loss: 2.1150920837402345
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 54.889007806777954
  time_this_iter_s: 26.54426622390747
  time_total_s: 54.889007806777954
  timestamp: 1661788696
  timesteps_since_restore: 0
  training_iteration: 2
  trial_id: '26514_00003'
  warmup_time: 0.0053937435150146484

(func pid=1658) Files already downloaded and verified
(func pid=1658) Files already downloaded and verified
(func pid=1624) [8, 10000] loss: 0.226
== Status ==
Current time: 2022-08-29 15:58:21 (running for 00:08:59.62)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.2205782720565796
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (5 PENDING, 2 RUNNING, 3 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00004 | RUNNING    | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:58:26 (running for 00:09:04.66)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: -1.508380093717575 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.2205782720565796
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (5 PENDING, 2 RUNNING, 3 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.24138 |     0.5545 |                    7 |
| train_cifar_26514_00004 | RUNNING    | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00000:
  accuracy: 0.5726
  date: 2022-08-29_15-58-29
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 8
  loss: 1.2221424466505646
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 544.627580165863
  time_this_iter_s: 72.02971982955933
  time_total_s: 544.627580165863
  timestamp: 1661788709
  timesteps_since_restore: 0
  training_iteration: 8
  trial_id: '26514_00000'
  warmup_time: 0.003681182861328125

== Status ==
Current time: 2022-08-29 15:58:34 (running for 00:09:12.78)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.2205782720565796
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (5 PENDING, 2 RUNNING, 3 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00004 | RUNNING    | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1,  2000] loss: 2.299
== Status ==
Current time: 2022-08-29 15:58:39 (running for 00:09:17.82)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.2205782720565796
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (5 PENDING, 2 RUNNING, 3 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00004 | RUNNING    | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [9,  2000] loss: 1.074
== Status ==
Current time: 2022-08-29 15:58:44 (running for 00:09:22.84)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.2205782720565796
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (5 PENDING, 2 RUNNING, 3 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00004 | RUNNING    | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 |         |            |                      |
| train_cifar_26514_00005 | PENDING    |                 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00004:
  accuracy: 0.1808
  date: 2022-08-29_15-58-46
  done: true
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 1
  loss: 2.273141198730469
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 29.723151683807373
  time_this_iter_s: 29.723151683807373
  time_total_s: 29.723151683807373
  timestamp: 1661788726
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '26514_00004'
  warmup_time: 0.0053937435150146484

(func pid=1658) Files already downloaded and verified
(func pid=1658) Files already downloaded and verified
== Status ==
Current time: 2022-08-29 15:58:51 (running for 00:09:29.39)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [9,  4000] loss: 0.552
== Status ==
Current time: 2022-08-29 15:58:56 (running for 00:09:34.41)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1,  2000] loss: 2.412
== Status ==
Current time: 2022-08-29 15:59:01 (running for 00:09:39.43)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [9,  6000] loss: 0.370
== Status ==
Current time: 2022-08-29 15:59:06 (running for 00:09:44.45)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1,  4000] loss: 1.207
== Status ==
Current time: 2022-08-29 15:59:11 (running for 00:09:49.47)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [9,  8000] loss: 0.274
== Status ==
Current time: 2022-08-29 15:59:16 (running for 00:09:54.49)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1,  6000] loss: 0.803
== Status ==
Current time: 2022-08-29 15:59:21 (running for 00:09:59.52)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [9, 10000] loss: 0.222
== Status ==
Current time: 2022-08-29 15:59:26 (running for 00:10:04.54)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1,  8000] loss: 0.602
== Status ==
Current time: 2022-08-29 15:59:31 (running for 00:10:09.57)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22214 |     0.5726 |                    8 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00000:
  accuracy: 0.5745
  date: 2022-08-29_15-59-35
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 9
  loss: 1.2214338063128292
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 610.4203913211823
  time_this_iter_s: 65.79281115531921
  time_total_s: 610.4203913211823
  timestamp: 1661788775
  timesteps_since_restore: 0
  training_iteration: 9
  trial_id: '26514_00000'
  warmup_time: 0.003681182861328125

(func pid=1658) [1, 10000] loss: 0.483
== Status ==
Current time: 2022-08-29 15:59:40 (running for 00:10:18.57)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:59:45 (running for 00:10:23.60)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [10,  2000] loss: 1.022
(func pid=1658) [1, 12000] loss: 0.402
== Status ==
Current time: 2022-08-29 15:59:50 (running for 00:10:28.62)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 15:59:55 (running for 00:10:33.65)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [10,  4000] loss: 0.533
(func pid=1658) [1, 14000] loss: 0.343
== Status ==
Current time: 2022-08-29 16:00:00 (running for 00:10:38.67)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:00:05 (running for 00:10:43.70)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [10,  6000] loss: 0.361
(func pid=1658) [1, 16000] loss: 0.303
== Status ==
Current time: 2022-08-29 16:00:10 (running for 00:10:48.72)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:00:15 (running for 00:10:53.74)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [10,  8000] loss: 0.270
(func pid=1658) [1, 18000] loss: 0.268
== Status ==
Current time: 2022-08-29 16:00:20 (running for 00:10:58.77)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:00:25 (running for 00:11:03.79)
Memory usage on this node: 2.8/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [10, 10000] loss: 0.215
(func pid=1658) [1, 20000] loss: 0.242
== Status ==
Current time: 2022-08-29 16:00:30 (running for 00:11:08.81)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:00:35 (running for 00:11:13.84)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (4 PENDING, 2 RUNNING, 4 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | RUNNING    | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.22143 |     0.5745 |                    9 |
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | PENDING    |                 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00000:
  accuracy: 0.5733
  date: 2022-08-29_16-00-39
  done: true
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 10
  loss: 1.2522373308330774
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 673.8709011077881
  time_this_iter_s: 63.450509786605835
  time_total_s: 673.8709011077881
  timestamp: 1661788839
  timesteps_since_restore: 0
  training_iteration: 10
  trial_id: '26514_00000'
  warmup_time: 0.003681182861328125

(func pid=1624) Files already downloaded and verified
(func pid=1624) Files already downloaded and verified
== Status ==
Current time: 2022-08-29 16:00:44 (running for 00:11:22.05)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=5
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (3 PENDING, 2 RUNNING, 5 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00005 | RUNNING    | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   |         |            |                      |
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | PENDING    |                 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00005:
  accuracy: 0.1022
  date: 2022-08-29_16-00-48
  done: true
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 1
  loss: 2.4324325805902483
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 121.50244855880737
  time_this_iter_s: 121.50244855880737
  time_total_s: 121.50244855880737
  timestamp: 1661788848
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '26514_00005'
  warmup_time: 0.0053937435150146484

(func pid=1658) Files already downloaded and verified
(func pid=1658) Files already downloaded and verified
== Status ==
Current time: 2022-08-29 16:00:53 (running for 00:11:30.91)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.288003533935547
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [1,  2000] loss: 2.043
== Status ==
Current time: 2022-08-29 16:00:58 (running for 00:11:35.95)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.288003533935547
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1,  2000] loss: 2.310
== Status ==
Current time: 2022-08-29 16:01:03 (running for 00:11:40.97)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.288003533935547
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [1,  4000] loss: 0.990
== Status ==
Current time: 2022-08-29 16:01:08 (running for 00:11:46.00)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.288003533935547
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1,  4000] loss: 1.136
== Status ==
Current time: 2022-08-29 16:01:13 (running for 00:11:51.02)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.288003533935547
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:01:18 (running for 00:11:56.05)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.288003533935547
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   |         |            |                      |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00006:
  accuracy: 0.2519
  date: 2022-08-29_16-01-20
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 1
  loss: 1.9627496683120726
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 40.821144580841064
  time_this_iter_s: 40.821144580841064
  time_total_s: 40.821144580841064
  timestamp: 1661788880
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '26514_00006'
  warmup_time: 0.003681182861328125

(func pid=1658) [1,  6000] loss: 0.711
== Status ==
Current time: 2022-08-29 16:01:25 (running for 00:12:02.88)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.96275 |     0.2519 |                    1 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:01:30 (running for 00:12:07.90)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.96275 |     0.2519 |                    1 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1,  8000] loss: 0.504
(func pid=1624) [2,  2000] loss: 1.958
== Status ==
Current time: 2022-08-29 16:01:35 (running for 00:12:12.92)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.96275 |     0.2519 |                    1 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:01:40 (running for 00:12:17.95)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.96275 |     0.2519 |                    1 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1, 10000] loss: 0.388
== Status ==
Current time: 2022-08-29 16:01:45 (running for 00:12:22.98)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.96275 |     0.2519 |                    1 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [2,  4000] loss: 0.969
== Status ==
Current time: 2022-08-29 16:01:50 (running for 00:12:28.00)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.96275 |     0.2519 |                    1 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1, 12000] loss: 0.312
== Status ==
Current time: 2022-08-29 16:01:55 (running for 00:12:33.02)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.1150920837402345 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.96275 |     0.2519 |                    1 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00006:
  accuracy: 0.2566
  date: 2022-08-29_16-01-58
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 2
  loss: 2.0194857375144957
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 79.6861481666565
  time_this_iter_s: 38.86500358581543
  time_total_s: 79.6861481666565
  timestamp: 1661788918
  timesteps_since_restore: 0
  training_iteration: 2
  trial_id: '26514_00006'
  warmup_time: 0.003681182861328125

(func pid=1658) [1, 14000] loss: 0.250
== Status ==
Current time: 2022-08-29 16:02:03 (running for 00:12:41.76)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 2.01949 |     0.2566 |                    2 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:02:08 (running for 00:12:46.79)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 2.01949 |     0.2566 |                    2 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [3,  2000] loss: 1.969
(func pid=1658) [1, 16000] loss: 0.216
== Status ==
Current time: 2022-08-29 16:02:13 (running for 00:12:51.81)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 2.01949 |     0.2566 |                    2 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:02:18 (running for 00:12:56.83)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 2.01949 |     0.2566 |                    2 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:02:23 (running for 00:13:01.84)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 2.01949 |     0.2566 |                    2 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1, 18000] loss: 0.186
(func pid=1624) [3,  4000] loss: 0.991
== Status ==
Current time: 2022-08-29 16:02:29 (running for 00:13:06.86)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 2.01949 |     0.2566 |                    2 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:02:34 (running for 00:13:11.88)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 2.01949 |     0.2566 |                    2 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [1, 20000] loss: 0.165
Result for train_cifar_26514_00006:
  accuracy: 0.2561
  date: 2022-08-29_16-02-38
  done: false
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 3
  loss: 1.9571901675224304
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 119.54396033287048
  time_this_iter_s: 39.85781216621399
  time_total_s: 119.54396033287048
  timestamp: 1661788958
  timesteps_since_restore: 0
  training_iteration: 3
  trial_id: '26514_00006'
  warmup_time: 0.003681182861328125

== Status ==
Current time: 2022-08-29 16:02:43 (running for 00:13:21.60)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95719 |     0.2561 |                    3 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:02:48 (running for 00:13:26.62)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95719 |     0.2561 |                    3 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 |         |            |                      |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00007:
  accuracy: 0.3979
  date: 2022-08-29_16-02-52
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 1
  loss: 1.6291288662463426
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 124.8290343284607
  time_this_iter_s: 124.8290343284607
  time_total_s: 124.8290343284607
  timestamp: 1661788972
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '26514_00007'
  warmup_time: 0.0053937435150146484

(func pid=1624) [4,  2000] loss: 1.973
== Status ==
Current time: 2022-08-29 16:02:57 (running for 00:13:35.76)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.205715936851502
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95719 |     0.2561 |                    3 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:03:02 (running for 00:13:40.78)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.205715936851502
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95719 |     0.2561 |                    3 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [2,  2000] loss: 1.617
(func pid=1624) [4,  4000] loss: 0.983
== Status ==
Current time: 2022-08-29 16:03:07 (running for 00:13:45.81)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.205715936851502
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95719 |     0.2561 |                    3 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:03:13 (running for 00:13:50.85)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.205715936851502
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95719 |     0.2561 |                    3 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [2,  4000] loss: 0.793
== Status ==
Current time: 2022-08-29 16:03:18 (running for 00:13:55.87)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=6
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6258524618029595 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.205715936851502
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 PENDING, 2 RUNNING, 6 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00006 | RUNNING    | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95719 |     0.2561 |                    3 |
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00008 | PENDING    |                 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00006:
  accuracy: 0.2557
  date: 2022-08-29_16-03-19
  done: true
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 4
  loss: 1.9527873064041137
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 160.40430665016174
  time_this_iter_s: 40.86034631729126
  time_total_s: 160.40430665016174
  timestamp: 1661788999
  timesteps_since_restore: 0
  training_iteration: 4
  trial_id: '26514_00006'
  warmup_time: 0.003681182861328125

(func pid=1624) Files already downloaded and verified
(func pid=1624) Files already downloaded and verified
(func pid=1658) [2,  6000] loss: 0.515
== Status ==
Current time: 2022-08-29 16:03:24 (running for 00:14:02.49)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.205715936851502
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 PENDING, 2 RUNNING, 7 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00008 | RUNNING    | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:03:29 (running for 00:14:07.52)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.205715936851502
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 PENDING, 2 RUNNING, 7 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00008 | RUNNING    | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:03:34 (running for 00:14:12.56)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.205715936851502
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 PENDING, 2 RUNNING, 7 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00008 | RUNNING    | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [2,  8000] loss: 0.383
(func pid=1624) [1,  2000] loss: 2.239
== Status ==
Current time: 2022-08-29 16:03:39 (running for 00:14:17.59)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.205715936851502
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 PENDING, 2 RUNNING, 7 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00008 | RUNNING    | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:03:44 (running for 00:14:22.63)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.205715936851502
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 PENDING, 2 RUNNING, 7 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00008 | RUNNING    | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   |         |            |                      |
| train_cifar_26514_00009 | PENDING    |                 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00008:
  accuracy: 0.1005
  date: 2022-08-29_16-03-46
  done: true
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 1
  loss: 2.3067330043792724
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 26.95584511756897
  time_this_iter_s: 26.95584511756897
  time_total_s: 26.95584511756897
  timestamp: 1661789026
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '26514_00008'
  warmup_time: 0.003681182861328125

(func pid=1658) [2, 10000] loss: 0.309
(func pid=1624) Files already downloaded and verified
(func pid=1624) Files already downloaded and verified
== Status ==
Current time: 2022-08-29 16:03:51 (running for 00:14:29.46)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00009 | RUNNING    | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:03:56 (running for 00:14:34.49)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00009 | RUNNING    | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [2, 12000] loss: 0.249
== Status ==
Current time: 2022-08-29 16:04:01 (running for 00:14:39.51)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00009 | RUNNING    | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:04:06 (running for 00:14:44.52)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00009 | RUNNING    | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1624) [1,  2000] loss: 2.301
(func pid=1658) [2, 14000] loss: 0.211
== Status ==
Current time: 2022-08-29 16:04:11 (running for 00:14:49.55)
Memory usage on this node: 2.7/14.7 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.273141198730469
Resources requested: 4.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00009 | RUNNING    | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 |         |            |                      |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00009:
  accuracy: 0.1295
  date: 2022-08-29_16-04-15
  done: true
  experiment_id: b7decaedec6d4d84b2c81ba5d8c3e72b
  hostname: 0ba3c9fad333
  iterations_since_restore: 1
  loss: 2.2946430000305176
  node_ip: 172.17.0.2
  pid: 1624
  should_checkpoint: true
  time_since_restore: 28.899584531784058
  time_this_iter_s: 28.899584531784058
  time_total_s: 28.899584531784058
  timestamp: 1661789055
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: '26514_00009'
  warmup_time: 0.003681182861328125

(func pid=1658) [2, 16000] loss: 0.183
== Status ==
Current time: 2022-08-29 16:04:20 (running for 00:14:58.38)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [2, 18000] loss: 0.160
== Status ==
Current time: 2022-08-29 16:04:25 (running for 00:15:03.39)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:04:30 (running for 00:15:08.41)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [2, 20000] loss: 0.142
== Status ==
Current time: 2022-08-29 16:04:35 (running for 00:15:13.43)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:04:40 (running for 00:15:18.44)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.067288910627365 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.62913 |     0.3979 |                    1 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00007:
  accuracy: 0.4616
  date: 2022-08-29_16-04-43
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 2
  loss: 1.4829822020828725
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 235.91004133224487
  time_this_iter_s: 111.08100700378418
  time_total_s: 235.91004133224487
  timestamp: 1661789083
  timesteps_since_restore: 0
  training_iteration: 2
  trial_id: '26514_00007'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 16:04:48 (running for 00:15:26.83)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3,  2000] loss: 1.377
== Status ==
Current time: 2022-08-29 16:04:54 (running for 00:15:31.85)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3,  4000] loss: 0.689
== Status ==
Current time: 2022-08-29 16:04:59 (running for 00:15:36.87)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:05:04 (running for 00:15:41.88)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3,  6000] loss: 0.458
== Status ==
Current time: 2022-08-29 16:05:09 (running for 00:15:46.89)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3,  8000] loss: 0.343
== Status ==
Current time: 2022-08-29 16:05:14 (running for 00:15:51.91)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:05:19 (running for 00:15:56.93)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3, 10000] loss: 0.269
== Status ==
Current time: 2022-08-29 16:05:24 (running for 00:16:01.94)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3, 12000] loss: 0.221
== Status ==
Current time: 2022-08-29 16:05:29 (running for 00:16:06.95)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3, 14000] loss: 0.188
== Status ==
Current time: 2022-08-29 16:05:34 (running for 00:16:11.97)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:05:39 (running for 00:16:16.98)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3, 16000] loss: 0.166
== Status ==
Current time: 2022-08-29 16:05:44 (running for 00:16:22.00)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3, 18000] loss: 0.147
== Status ==
Current time: 2022-08-29 16:05:49 (running for 00:16:27.01)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:05:54 (running for 00:16:32.02)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [3, 20000] loss: 0.130
== Status ==
Current time: 2022-08-29 16:05:59 (running for 00:16:37.03)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:06:04 (running for 00:16:42.05)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.48298 |     0.4616 |                    2 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00007:
  accuracy: 0.5051
  date: 2022-08-29_16-06-06
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 3
  loss: 1.3714316166367382
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 318.6962983608246
  time_this_iter_s: 82.78625702857971
  time_total_s: 318.6962983608246
  timestamp: 1661789166
  timesteps_since_restore: 0
  training_iteration: 3
  trial_id: '26514_00007'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 16:06:11 (running for 00:16:49.62)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4,  2000] loss: 1.257
== Status ==
Current time: 2022-08-29 16:06:16 (running for 00:16:54.64)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4,  4000] loss: 0.643
== Status ==
Current time: 2022-08-29 16:06:21 (running for 00:16:59.65)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:06:26 (running for 00:17:04.66)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4,  6000] loss: 0.425
== Status ==
Current time: 2022-08-29 16:06:31 (running for 00:17:09.67)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4,  8000] loss: 0.314
== Status ==
Current time: 2022-08-29 16:06:36 (running for 00:17:14.69)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:06:41 (running for 00:17:19.70)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4, 10000] loss: 0.248
== Status ==
Current time: 2022-08-29 16:06:46 (running for 00:17:24.72)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4, 12000] loss: 0.211
== Status ==
Current time: 2022-08-29 16:06:51 (running for 00:17:29.73)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4, 14000] loss: 0.172
== Status ==
Current time: 2022-08-29 16:06:56 (running for 00:17:34.75)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:07:01 (running for 00:17:39.76)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4, 16000] loss: 0.155
== Status ==
Current time: 2022-08-29 16:07:06 (running for 00:17:44.78)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4, 18000] loss: 0.134
== Status ==
Current time: 2022-08-29 16:07:11 (running for 00:17:49.79)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:07:16 (running for 00:17:54.81)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [4, 20000] loss: 0.119
== Status ==
Current time: 2022-08-29 16:07:21 (running for 00:17:59.82)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:07:26 (running for 00:18:04.83)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.9242985949516296 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.37143 |     0.5051 |                    3 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00007:
  accuracy: 0.5222
  date: 2022-08-29_16-07-29
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 4
  loss: 1.3345781434495
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 401.6076309680939
  time_this_iter_s: 82.91133260726929
  time_total_s: 401.6076309680939
  timestamp: 1661789249
  timesteps_since_restore: 0
  training_iteration: 4
  trial_id: '26514_00007'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 16:07:34 (running for 00:18:12.53)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5,  2000] loss: 1.151
== Status ==
Current time: 2022-08-29 16:07:39 (running for 00:18:17.55)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5,  4000] loss: 0.587
== Status ==
Current time: 2022-08-29 16:07:44 (running for 00:18:22.56)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:07:49 (running for 00:18:27.57)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5,  6000] loss: 0.387
== Status ==
Current time: 2022-08-29 16:07:54 (running for 00:18:32.58)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5,  8000] loss: 0.286
== Status ==
Current time: 2022-08-29 16:07:59 (running for 00:18:37.60)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:08:04 (running for 00:18:42.61)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5, 10000] loss: 0.232
== Status ==
Current time: 2022-08-29 16:08:09 (running for 00:18:47.63)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5, 12000] loss: 0.201
== Status ==
Current time: 2022-08-29 16:08:14 (running for 00:18:52.64)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:08:19 (running for 00:18:57.66)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5, 14000] loss: 0.167
== Status ==
Current time: 2022-08-29 16:08:24 (running for 00:19:02.67)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5, 16000] loss: 0.146
== Status ==
Current time: 2022-08-29 16:08:29 (running for 00:19:07.69)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5, 18000] loss: 0.130
== Status ==
Current time: 2022-08-29 16:08:34 (running for 00:19:12.70)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:08:39 (running for 00:19:17.72)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [5, 20000] loss: 0.114
== Status ==
Current time: 2022-08-29 16:08:44 (running for 00:19:22.73)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:08:49 (running for 00:19:27.75)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.33458 |     0.5222 |                    4 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00007:
  accuracy: 0.5762
  date: 2022-08-29_16-08-53
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 5
  loss: 1.1922143974222243
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 485.02561688423157
  time_this_iter_s: 83.4179859161377
  time_total_s: 485.02561688423157
  timestamp: 1661789333
  timesteps_since_restore: 0
  training_iteration: 5
  trial_id: '26514_00007'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 16:08:58 (running for 00:19:35.95)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6,  2000] loss: 1.072
== Status ==
Current time: 2022-08-29 16:09:03 (running for 00:19:40.97)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6,  4000] loss: 0.548
== Status ==
Current time: 2022-08-29 16:09:08 (running for 00:19:45.98)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:09:13 (running for 00:19:51.00)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6,  6000] loss: 0.364
== Status ==
Current time: 2022-08-29 16:09:18 (running for 00:19:56.01)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6,  8000] loss: 0.280
== Status ==
Current time: 2022-08-29 16:09:23 (running for 00:20:01.02)
Memory usage on this node: 2.2/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:09:28 (running for 00:20:06.03)
Memory usage on this node: 2.2/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6, 10000] loss: 0.225
== Status ==
Current time: 2022-08-29 16:09:33 (running for 00:20:11.05)
Memory usage on this node: 2.2/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6, 12000] loss: 0.191
== Status ==
Current time: 2022-08-29 16:09:38 (running for 00:20:16.06)
Memory usage on this node: 2.2/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6, 14000] loss: 0.160
== Status ==
Current time: 2022-08-29 16:09:43 (running for 00:20:21.08)
Memory usage on this node: 2.2/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:09:48 (running for 00:20:26.09)
Memory usage on this node: 2.2/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6, 16000] loss: 0.141
== Status ==
Current time: 2022-08-29 16:09:53 (running for 00:20:31.11)
Memory usage on this node: 2.2/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6, 18000] loss: 0.122
== Status ==
Current time: 2022-08-29 16:09:58 (running for 00:20:36.12)
Memory usage on this node: 2.2/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:10:03 (running for 00:20:41.14)
Memory usage on this node: 2.2/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [6, 20000] loss: 0.110
== Status ==
Current time: 2022-08-29 16:10:08 (running for 00:20:46.15)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:10:13 (running for 00:20:51.17)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.19221 |     0.5762 |                    5 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00007:
  accuracy: 0.5883
  date: 2022-08-29_16-10-15
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 6
  loss: 1.1703836522427387
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 567.6703226566315
  time_this_iter_s: 82.6447057723999
  time_total_s: 567.6703226566315
  timestamp: 1661789415
  timesteps_since_restore: 0
  training_iteration: 6
  trial_id: '26514_00007'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 16:10:20 (running for 00:20:58.59)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7,  2000] loss: 1.082
== Status ==
Current time: 2022-08-29 16:10:25 (running for 00:21:03.61)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7,  4000] loss: 0.527
== Status ==
Current time: 2022-08-29 16:10:30 (running for 00:21:08.62)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:10:35 (running for 00:21:13.64)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7,  6000] loss: 0.357
== Status ==
Current time: 2022-08-29 16:10:40 (running for 00:21:18.65)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7,  8000] loss: 0.267
== Status ==
Current time: 2022-08-29 16:10:45 (running for 00:21:23.67)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:10:50 (running for 00:21:28.68)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7, 10000] loss: 0.211
== Status ==
Current time: 2022-08-29 16:10:55 (running for 00:21:33.70)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7, 12000] loss: 0.176
== Status ==
Current time: 2022-08-29 16:11:00 (running for 00:21:38.71)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:11:05 (running for 00:21:43.72)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7, 14000] loss: 0.155
== Status ==
Current time: 2022-08-29 16:11:10 (running for 00:21:48.73)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7, 16000] loss: 0.132
== Status ==
Current time: 2022-08-29 16:11:15 (running for 00:21:53.75)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7, 18000] loss: 0.120
== Status ==
Current time: 2022-08-29 16:11:20 (running for 00:21:58.76)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:11:25 (running for 00:22:03.78)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [7, 20000] loss: 0.107
== Status ==
Current time: 2022-08-29 16:11:30 (running for 00:22:08.79)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:11:35 (running for 00:22:13.81)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.17038 |     0.5883 |                    6 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00007:
  accuracy: 0.5962
  date: 2022-08-29_16-11-39
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 7
  loss: 1.1514908161045052
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 650.9815549850464
  time_this_iter_s: 83.31123232841492
  time_total_s: 650.9815549850464
  timestamp: 1661789499
  timesteps_since_restore: 0
  training_iteration: 7
  trial_id: '26514_00007'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 16:11:44 (running for 00:22:21.90)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8,  2000] loss: 1.012
== Status ==
Current time: 2022-08-29 16:11:49 (running for 00:22:26.92)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8,  4000] loss: 0.496
== Status ==
Current time: 2022-08-29 16:11:54 (running for 00:22:31.93)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:11:59 (running for 00:22:36.94)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8,  6000] loss: 0.344
== Status ==
Current time: 2022-08-29 16:12:04 (running for 00:22:41.95)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8,  8000] loss: 0.267
== Status ==
Current time: 2022-08-29 16:12:09 (running for 00:22:46.97)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:12:14 (running for 00:22:51.98)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8, 10000] loss: 0.204
== Status ==
Current time: 2022-08-29 16:12:19 (running for 00:22:57.00)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8, 12000] loss: 0.170
== Status ==
Current time: 2022-08-29 16:12:24 (running for 00:23:02.01)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:12:29 (running for 00:23:07.03)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8, 14000] loss: 0.145
== Status ==
Current time: 2022-08-29 16:12:34 (running for 00:23:12.04)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8, 16000] loss: 0.127
== Status ==
Current time: 2022-08-29 16:12:39 (running for 00:23:17.05)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:12:44 (running for 00:23:22.06)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8, 18000] loss: 0.113
== Status ==
Current time: 2022-08-29 16:12:49 (running for 00:23:27.08)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [8, 20000] loss: 0.104
== Status ==
Current time: 2022-08-29 16:12:54 (running for 00:23:32.09)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:12:59 (running for 00:23:37.11)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.3652612701840698 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.15149 |     0.5962 |                    7 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00007:
  accuracy: 0.5841
  date: 2022-08-29_16-13-03
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 8
  loss: 1.183217224018043
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 735.1395463943481
  time_this_iter_s: 84.15799140930176
  time_total_s: 735.1395463943481
  timestamp: 1661789583
  timesteps_since_restore: 0
  training_iteration: 8
  trial_id: '26514_00007'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 16:13:08 (running for 00:23:46.06)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [9,  2000] loss: 0.969
== Status ==
Current time: 2022-08-29 16:13:13 (running for 00:23:51.08)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [9,  4000] loss: 0.492
== Status ==
Current time: 2022-08-29 16:13:18 (running for 00:23:56.09)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:13:23 (running for 00:24:01.11)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [9,  6000] loss: 0.325
== Status ==
Current time: 2022-08-29 16:13:28 (running for 00:24:06.12)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [9,  8000] loss: 0.243
== Status ==
Current time: 2022-08-29 16:13:33 (running for 00:24:11.14)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:13:38 (running for 00:24:16.15)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [9, 10000] loss: 0.195
== Status ==
Current time: 2022-08-29 16:13:43 (running for 00:24:21.16)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [9, 12000] loss: 0.166
== Status ==
Current time: 2022-08-29 16:13:48 (running for 00:24:26.18)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:13:53 (running for 00:24:31.19)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [9, 14000] loss: 0.143
== Status ==
Current time: 2022-08-29 16:13:58 (running for 00:24:36.20)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [9, 16000] loss: 0.124
== Status ==
Current time: 2022-08-29 16:14:03 (running for 00:24:41.22)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:14:08 (running for 00:24:46.23)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [9, 18000] loss: 0.115
== Status ==
Current time: 2022-08-29 16:14:13 (running for 00:24:51.24)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [9, 20000] loss: 0.102
== Status ==
Current time: 2022-08-29 16:14:18 (running for 00:24:56.26)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:14:23 (running for 00:25:01.28)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.18322 |     0.5841 |                    8 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00007:
  accuracy: 0.6049
  date: 2022-08-29_16-14-27
  done: false
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 9
  loss: 1.1368257117977831
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 819.2267661094666
  time_this_iter_s: 84.08721971511841
  time_total_s: 819.2267661094666
  timestamp: 1661789667
  timesteps_since_restore: 0
  training_iteration: 9
  trial_id: '26514_00007'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 16:14:32 (running for 00:25:10.15)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10,  2000] loss: 0.944
== Status ==
Current time: 2022-08-29 16:14:37 (running for 00:25:15.17)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10,  4000] loss: 0.466
== Status ==
Current time: 2022-08-29 16:14:42 (running for 00:25:20.18)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:14:47 (running for 00:25:25.20)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10,  6000] loss: 0.316
== Status ==
Current time: 2022-08-29 16:14:52 (running for 00:25:30.21)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10,  8000] loss: 0.235
== Status ==
Current time: 2022-08-29 16:14:57 (running for 00:25:35.22)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:15:02 (running for 00:25:40.24)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10, 10000] loss: 0.189
== Status ==
Current time: 2022-08-29 16:15:07 (running for 00:25:45.25)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10, 12000] loss: 0.165
== Status ==
Current time: 2022-08-29 16:15:12 (running for 00:25:50.27)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:15:17 (running for 00:25:55.28)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10, 14000] loss: 0.136
== Status ==
Current time: 2022-08-29 16:15:22 (running for 00:26:00.29)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10, 16000] loss: 0.122
== Status ==
Current time: 2022-08-29 16:15:27 (running for 00:26:05.31)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10, 18000] loss: 0.111
== Status ==
Current time: 2022-08-29 16:15:32 (running for 00:26:10.32)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:15:37 (running for 00:26:15.34)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(func pid=1658) [10, 20000] loss: 0.101
== Status ==
Current time: 2022-08-29 16:15:42 (running for 00:26:20.35)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Current time: 2022-08-29 16:15:47 (running for 00:26:25.37)
Memory usage on this node: 2.1/14.7 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 2.0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00007 | RUNNING    | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.13683 |     0.6049 |                    9 |
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for train_cifar_26514_00007:
  accuracy: 0.5733
  date: 2022-08-29_16-15-50
  done: true
  experiment_id: 9f6c27bb35454322ad898395be650a7a
  hostname: 0ba3c9fad333
  iterations_since_restore: 10
  loss: 1.230402131993731
  node_ip: 172.17.0.2
  pid: 1658
  should_checkpoint: true
  time_since_restore: 902.9133651256561
  time_this_iter_s: 83.68659901618958
  time_total_s: 902.9133651256561
  timestamp: 1661789750
  timesteps_since_restore: 0
  training_iteration: 10
  trial_id: '26514_00007'
  warmup_time: 0.0053937435150146484

== Status ==
Current time: 2022-08-29 16:15:50 (running for 00:26:28.84)
Memory usage on this node: 1.8/14.7 GiB
Using AsyncHyperBand: num_stopped=10
Bracket: Iter 8.000: -1.2221424466505646 | Iter 4.000: -1.6294383692005647 | Iter 2.000: -2.0194857375144957 | Iter 1.000: -2.283892099380493
Resources requested: 0/4 CPUs, 0/1 GPUs, 0.0/8.17 GiB heap, 0.0/4.08 GiB objects (0.0/1.0 accelerator_type:P4)
Result logdir: /var/lib/jenkins/ray_results/train_cifar_2022-08-29_15-49-21
Number of trials: 10/10 (10 TERMINATED)
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name              | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| train_cifar_26514_00000 | TERMINATED | 172.17.0.2:1624 |            4 |   64 |    4 | 0.000560935 | 1.25224 |     0.5733 |                   10 |
| train_cifar_26514_00001 | TERMINATED | 172.17.0.2:1658 |            8 |  128 |    8 | 0.000151196 | 1.43149 |     0.4799 |                   10 |
| train_cifar_26514_00002 | TERMINATED | 172.17.0.2:1658 |            4 |   32 |   16 | 0.0339499   | 2.31799 |     0.1004 |                    1 |
| train_cifar_26514_00003 | TERMINATED | 172.17.0.2:1658 |           16 |   32 |   32 | 0.0350159   | 2.11509 |     0.197  |                    2 |
| train_cifar_26514_00004 | TERMINATED | 172.17.0.2:1658 |           16 |   64 |   64 | 0.000321414 | 2.27314 |     0.1808 |                    1 |
| train_cifar_26514_00005 | TERMINATED | 172.17.0.2:1658 |            2 |    8 |   16 | 0.0986395   | 2.43243 |     0.1022 |                    1 |
| train_cifar_26514_00006 | TERMINATED | 172.17.0.2:1624 |            8 |  128 |   16 | 0.0177239   | 1.95279 |     0.2557 |                    4 |
| train_cifar_26514_00007 | TERMINATED | 172.17.0.2:1658 |            2 |   64 |    8 | 0.000265547 | 1.2304  |     0.5733 |                   10 |
| train_cifar_26514_00008 | TERMINATED | 172.17.0.2:1624 |           16 |    8 |   16 | 0.0569484   | 2.30673 |     0.1005 |                    1 |
| train_cifar_26514_00009 | TERMINATED | 172.17.0.2:1624 |           16 |  256 |  128 | 0.000106904 | 2.29464 |     0.1295 |                    1 |
+-------------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Best trial config: {'l1': 64, 'l2': 8, 'lr': 0.00026554671727783773, 'batch_size': 2}
Best trial final validation loss: 1.230402131993731
Best trial final validation accuracy: 0.5733
Files already downloaded and verified
Files already downloaded and verified
Best trial test set accuracy: 0.5831

If you run the code, an example output could look like this:

Number of trials: 10 (10 TERMINATED)
+-----+------+------+-------------+--------------+---------+------------+--------------------+
| ... |   l1 |   l2 |          lr |   batch_size |    loss |   accuracy | training_iteration |
|-----+------+------+-------------+--------------+---------+------------+--------------------|
| ... |   64 |    4 | 0.00011629  |            2 | 1.87273 |     0.244  |                  2 |
| ... |   32 |   64 | 0.000339763 |            8 | 1.23603 |     0.567  |                  8 |
| ... |    8 |   16 | 0.00276249  |           16 | 1.1815  |     0.5836 |                 10 |
| ... |    4 |   64 | 0.000648721 |            4 | 1.31131 |     0.5224 |                  8 |
| ... |   32 |   16 | 0.000340753 |            8 | 1.26454 |     0.5444 |                  8 |
| ... |    8 |    4 | 0.000699775 |            8 | 1.99594 |     0.1983 |                  2 |
| ... |  256 |    8 | 0.0839654   |           16 | 2.3119  |     0.0993 |                  1 |
| ... |   16 |  128 | 0.0758154   |           16 | 2.33575 |     0.1327 |                  1 |
| ... |   16 |    8 | 0.0763312   |           16 | 2.31129 |     0.1042 |                  4 |
| ... |  128 |   16 | 0.000124903 |            4 | 2.26917 |     0.1945 |                  1 |
+-----+------+------+-------------+--------------+---------+------------+--------------------+


Best trial config: {'l1': 8, 'l2': 16, 'lr': 0.00276249, 'batch_size': 16, 'data_dir': '...'}
Best trial final validation loss: 1.181501
Best trial final validation accuracy: 0.5836
Best trial test set accuracy: 0.5806

Most trials have been stopped early in order to avoid wasting resources. The best performing trial achieved a validation accuracy of about 58%, which could be confirmed on the test set.

So that’s it! You can now tune the parameters of your PyTorch models.