Shortcuts

Hyperparameter tuning with Ray Tune

Hyperparameter tuning can make the difference between an average model and a highly accurate one. Often simple things like choosing a different learning rate or changing a network layer size can have a dramatic impact on your model performance.

Fortunately, there are tools that help with finding the best combination of parameters. Ray Tune is an industry standard tool for distributed hyperparameter tuning. Ray Tune includes the latest hyperparameter search algorithms, integrates with TensorBoard and other analysis libraries, and natively supports distributed training through Ray’s distributed machine learning engine.

In this tutorial, we will show you how to integrate Ray Tune into your PyTorch training workflow. We will extend this tutorial from the PyTorch documentation for training a CIFAR10 image classifier.

As you will see, we only need to add some slight modifications. In particular, we need to

  1. wrap data loading and training in functions,
  2. make some network parameters configurable,
  3. add checkpointing (optional),
  4. and define the search space for the model tuning

To run this tutorial, please make sure the following packages are installed:

  • ray[tune]: Distributed hyperparameter tuning library
  • torchvision: For the data transformers

Setup / Imports

Let’s start with the imports:

from functools import partial
import numpy as np
import os
import torch
import torch.nn as nn
import torch.nn.functional as F
import torch.optim as optim
from torch.utils.data import random_split
import torchvision
import torchvision.transforms as transforms
from ray import tune
from ray.tune import CLIReporter
from ray.tune.schedulers import ASHAScheduler

Most of the imports are needed for building the PyTorch model. Only the last three imports are for Ray Tune.

Data loaders

We wrap the data loaders in their own function and pass a global data directory. This way we can share a data directory between different trials.

def load_data(data_dir="./data"):
    transform = transforms.Compose([
        transforms.ToTensor(),
        transforms.Normalize((0.5, 0.5, 0.5), (0.5, 0.5, 0.5))
    ])

    trainset = torchvision.datasets.CIFAR10(
        root=data_dir, train=True, download=True, transform=transform)

    testset = torchvision.datasets.CIFAR10(
        root=data_dir, train=False, download=True, transform=transform)

    return trainset, testset

Configurable neural network

We can only tune those parameters that are configurable. In this example, we can specify the layer sizes of the fully connected layers:

class Net(nn.Module):
    def __init__(self, l1=120, l2=84):
        super(Net, self).__init__()
        self.conv1 = nn.Conv2d(3, 6, 5)
        self.pool = nn.MaxPool2d(2, 2)
        self.conv2 = nn.Conv2d(6, 16, 5)
        self.fc1 = nn.Linear(16 * 5 * 5, l1)
        self.fc2 = nn.Linear(l1, l2)
        self.fc3 = nn.Linear(l2, 10)

    def forward(self, x):
        x = self.pool(F.relu(self.conv1(x)))
        x = self.pool(F.relu(self.conv2(x)))
        x = x.view(-1, 16 * 5 * 5)
        x = F.relu(self.fc1(x))
        x = F.relu(self.fc2(x))
        x = self.fc3(x)
        return x

The train function

Now it gets interesting, because we introduce some changes to the example from the PyTorch documentation.

We wrap the training script in a function train_cifar(config, checkpoint_dir=None, data_dir=None). As you can guess, the config parameter will receive the hyperparameters we would like to train with. The checkpoint_dir parameter is used to restore checkpoints. The data_dir specifies the directory where we load and store the data, so multiple runs can share the same data source.

net = Net(config["l1"], config["l2"])

if checkpoint_dir:
    model_state, optimizer_state = torch.load(
        os.path.join(checkpoint_dir, "checkpoint"))
    net.load_state_dict(model_state)
    optimizer.load_state_dict(optimizer_state)

The learning rate of the optimizer is made configurable, too:

optimizer = optim.SGD(net.parameters(), lr=config["lr"], momentum=0.9)

We also split the training data into a training and validation subset. We thus train on 80% of the data and calculate the validation loss on the remaining 20%. The batch sizes with which we iterate through the training and test sets are configurable as well.

Adding (multi) GPU support with DataParallel

Image classification benefits largely from GPUs. Luckily, we can continue to use PyTorch’s abstractions in Ray Tune. Thus, we can wrap our model in nn.DataParallel to support data parallel training on multiple GPUs:

device = "cpu"
if torch.cuda.is_available():
    device = "cuda:0"
    if torch.cuda.device_count() > 1:
        net = nn.DataParallel(net)
net.to(device)

By using a device variable we make sure that training also works when we have no GPUs available. PyTorch requires us to send our data to the GPU memory explicitly, like this:

for i, data in enumerate(trainloader, 0):
    inputs, labels = data
    inputs, labels = inputs.to(device), labels.to(device)

The code now supports training on CPUs, on a single GPU, and on multiple GPUs. Notably, Ray also supports fractional GPUs so we can share GPUs among trials, as long as the model still fits on the GPU memory. We’ll come back to that later.

Communicating with Ray Tune

The most interesting part is the communication with Ray Tune:

with tune.checkpoint_dir(epoch) as checkpoint_dir:
    path = os.path.join(checkpoint_dir, "checkpoint")
    torch.save((net.state_dict(), optimizer.state_dict()), path)

tune.report(loss=(val_loss / val_steps), accuracy=correct / total)

Here we first save a checkpoint and then report some metrics back to Ray Tune. Specifically, we send the validation loss and accuracy back to Ray Tune. Ray Tune can then use these metrics to decide which hyperparameter configuration lead to the best results. These metrics can also be used to stop bad performing trials early in order to avoid wasting resources on those trials.

The checkpoint saving is optional, however, it is necessary if we wanted to use advanced schedulers like Population Based Training. Also, by saving the checkpoint we can later load the trained models and validate them on a test set.

Full training function

The full code example looks like this:

def train_cifar(config, checkpoint_dir=None, data_dir=None):
    net = Net(config["l1"], config["l2"])

    device = "cpu"
    if torch.cuda.is_available():
        device = "cuda:0"
        if torch.cuda.device_count() > 1:
            net = nn.DataParallel(net)
    net.to(device)

    criterion = nn.CrossEntropyLoss()
    optimizer = optim.SGD(net.parameters(), lr=config["lr"], momentum=0.9)

    if checkpoint_dir:
        model_state, optimizer_state = torch.load(
            os.path.join(checkpoint_dir, "checkpoint"))
        net.load_state_dict(model_state)
        optimizer.load_state_dict(optimizer_state)

    trainset, testset = load_data(data_dir)

    test_abs = int(len(trainset) * 0.8)
    train_subset, val_subset = random_split(
        trainset, [test_abs, len(trainset) - test_abs])

    trainloader = torch.utils.data.DataLoader(
        train_subset,
        batch_size=int(config["batch_size"]),
        shuffle=True,
        num_workers=8)
    valloader = torch.utils.data.DataLoader(
        val_subset,
        batch_size=int(config["batch_size"]),
        shuffle=True,
        num_workers=8)

    for epoch in range(10):  # loop over the dataset multiple times
        running_loss = 0.0
        epoch_steps = 0
        for i, data in enumerate(trainloader, 0):
            # get the inputs; data is a list of [inputs, labels]
            inputs, labels = data
            inputs, labels = inputs.to(device), labels.to(device)

            # zero the parameter gradients
            optimizer.zero_grad()

            # forward + backward + optimize
            outputs = net(inputs)
            loss = criterion(outputs, labels)
            loss.backward()
            optimizer.step()

            # print statistics
            running_loss += loss.item()
            epoch_steps += 1
            if i % 2000 == 1999:  # print every 2000 mini-batches
                print("[%d, %5d] loss: %.3f" % (epoch + 1, i + 1,
                                                running_loss / epoch_steps))
                running_loss = 0.0

        # Validation loss
        val_loss = 0.0
        val_steps = 0
        total = 0
        correct = 0
        for i, data in enumerate(valloader, 0):
            with torch.no_grad():
                inputs, labels = data
                inputs, labels = inputs.to(device), labels.to(device)

                outputs = net(inputs)
                _, predicted = torch.max(outputs.data, 1)
                total += labels.size(0)
                correct += (predicted == labels).sum().item()

                loss = criterion(outputs, labels)
                val_loss += loss.cpu().numpy()
                val_steps += 1

        with tune.checkpoint_dir(epoch) as checkpoint_dir:
            path = os.path.join(checkpoint_dir, "checkpoint")
            torch.save((net.state_dict(), optimizer.state_dict()), path)

        tune.report(loss=(val_loss / val_steps), accuracy=correct / total)
    print("Finished Training")

As you can see, most of the code is adapted directly from the original example.

Test set accuracy

Commonly the performance of a machine learning model is tested on a hold-out test set with data that has not been used for training the model. We also wrap this in a function:

def test_accuracy(net, device="cpu"):
    trainset, testset = load_data()

    testloader = torch.utils.data.DataLoader(
        testset, batch_size=4, shuffle=False, num_workers=2)

    correct = 0
    total = 0
    with torch.no_grad():
        for data in testloader:
            images, labels = data
            images, labels = images.to(device), labels.to(device)
            outputs = net(images)
            _, predicted = torch.max(outputs.data, 1)
            total += labels.size(0)
            correct += (predicted == labels).sum().item()

    return correct / total

The function also expects a device parameter, so we can do the test set validation on a GPU.

Configuring the search space

Lastly, we need to define Ray Tune’s search space. Here is an example:

config = {
    "l1": tune.sample_from(lambda _: 2**np.random.randint(2, 9)),
    "l2": tune.sample_from(lambda _: 2**np.random.randint(2, 9)),
    "lr": tune.loguniform(1e-4, 1e-1),
    "batch_size": tune.choice([2, 4, 8, 16])
}

The tune.sample_from() function makes it possible to define your own sample methods to obtain hyperparameters. In this example, the l1 and l2 parameters should be powers of 2 between 4 and 256, so either 4, 8, 16, 32, 64, 128, or 256. The lr (learning rate) should be uniformly sampled between 0.0001 and 0.1. Lastly, the batch size is a choice between 2, 4, 8, and 16.

At each trial, Ray Tune will now randomly sample a combination of parameters from these search spaces. It will then train a number of models in parallel and find the best performing one among these. We also use the ASHAScheduler which will terminate bad performing trials early.

We wrap the train_cifar function with functools.partial to set the constant data_dir parameter. We can also tell Ray Tune what resources should be available for each trial:

gpus_per_trial = 2
# ...
result = tune.run(
    partial(train_cifar, data_dir=data_dir),
    resources_per_trial={"cpu": 8, "gpu": gpus_per_trial},
    config=config,
    num_samples=num_samples,
    scheduler=scheduler,
    progress_reporter=reporter,
    checkpoint_at_end=True)

You can specify the number of CPUs, which are then available e.g. to increase the num_workers of the PyTorch DataLoader instances. The selected number of GPUs are made visible to PyTorch in each trial. Trials do not have access to GPUs that haven’t been requested for them - so you don’t have to care about two trials using the same set of resources.

Here we can also specify fractional GPUs, so something like gpus_per_trial=0.5 is completely valid. The trials will then share GPUs among each other. You just have to make sure that the models still fit in the GPU memory.

After training the models, we will find the best performing one and load the trained network from the checkpoint file. We then obtain the test set accuracy and report everything by printing.

The full main function looks like this:

def main(num_samples=10, max_num_epochs=10, gpus_per_trial=2):
    data_dir = os.path.abspath("./data")
    load_data(data_dir)
    config = {
        "l1": tune.sample_from(lambda _: 2 ** np.random.randint(2, 9)),
        "l2": tune.sample_from(lambda _: 2 ** np.random.randint(2, 9)),
        "lr": tune.loguniform(1e-4, 1e-1),
        "batch_size": tune.choice([2, 4, 8, 16])
    }
    scheduler = ASHAScheduler(
        metric="loss",
        mode="min",
        max_t=max_num_epochs,
        grace_period=1,
        reduction_factor=2)
    reporter = CLIReporter(
        # parameter_columns=["l1", "l2", "lr", "batch_size"],
        metric_columns=["loss", "accuracy", "training_iteration"])
    result = tune.run(
        partial(train_cifar, data_dir=data_dir),
        resources_per_trial={"cpu": 2, "gpu": gpus_per_trial},
        config=config,
        num_samples=num_samples,
        scheduler=scheduler,
        progress_reporter=reporter)

    best_trial = result.get_best_trial("loss", "min", "last")
    print("Best trial config: {}".format(best_trial.config))
    print("Best trial final validation loss: {}".format(
        best_trial.last_result["loss"]))
    print("Best trial final validation accuracy: {}".format(
        best_trial.last_result["accuracy"]))

    best_trained_model = Net(best_trial.config["l1"], best_trial.config["l2"])
    device = "cpu"
    if torch.cuda.is_available():
        device = "cuda:0"
        if gpus_per_trial > 1:
            best_trained_model = nn.DataParallel(best_trained_model)
    best_trained_model.to(device)

    best_checkpoint_dir = best_trial.checkpoint.value
    model_state, optimizer_state = torch.load(os.path.join(
        best_checkpoint_dir, "checkpoint"))
    best_trained_model.load_state_dict(model_state)

    test_acc = test_accuracy(best_trained_model, device)
    print("Best trial test set accuracy: {}".format(test_acc))


if __name__ == "__main__":
    # You can change the number of GPUs per trial here:
    main(num_samples=10, max_num_epochs=10, gpus_per_trial=0)

Out:

Downloading https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz to /var/lib/jenkins/workspace/beginner_source/data/cifar-10-python.tar.gz
Extracting /var/lib/jenkins/workspace/beginner_source/data/cifar-10-python.tar.gz to /var/lib/jenkins/workspace/beginner_source/data
Files already downloaded and verified
== Status ==
Memory usage on this node: 4.1/240.1 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (9 PENDING, 1 RUNNING)
+---------------------+----------+-------+--------------+------+------+-------------+
| Trial name          | status   | loc   |   batch_size |   l1 |   l2 |          lr |
|---------------------+----------+-------+--------------+------+------+-------------|
| DEFAULT_155f0_00000 | RUNNING  |       |            4 |   64 |  256 | 0.000408745 |
| DEFAULT_155f0_00001 | PENDING  |       |            8 |   16 |  128 | 0.000189492 |
| DEFAULT_155f0_00002 | PENDING  |       |            2 |  256 |  256 | 0.0109037   |
| DEFAULT_155f0_00003 | PENDING  |       |            2 |   64 |  256 | 0.000324679 |
| DEFAULT_155f0_00004 | PENDING  |       |           16 |   32 |   32 | 0.00829854  |
| DEFAULT_155f0_00005 | PENDING  |       |           16 |    4 |    4 | 0.00104528  |
| DEFAULT_155f0_00006 | PENDING  |       |            2 |    4 |  128 | 0.000144118 |
| DEFAULT_155f0_00007 | PENDING  |       |            2 |  256 |    8 | 0.00529693  |
| DEFAULT_155f0_00008 | PENDING  |       |           16 |  128 |    4 | 0.000230149 |
| DEFAULT_155f0_00009 | PENDING  |       |            4 |   16 |   64 | 0.00250992  |
+---------------------+----------+-------+--------------+------+------+-------------+


== Status ==
Memory usage on this node: 5.3/240.1 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 20.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (10 RUNNING)
+---------------------+----------+-------+--------------+------+------+-------------+
| Trial name          | status   | loc   |   batch_size |   l1 |   l2 |          lr |
|---------------------+----------+-------+--------------+------+------+-------------|
| DEFAULT_155f0_00000 | RUNNING  |       |            4 |   64 |  256 | 0.000408745 |
| DEFAULT_155f0_00001 | RUNNING  |       |            8 |   16 |  128 | 0.000189492 |
| DEFAULT_155f0_00002 | RUNNING  |       |            2 |  256 |  256 | 0.0109037   |
| DEFAULT_155f0_00003 | RUNNING  |       |            2 |   64 |  256 | 0.000324679 |
| DEFAULT_155f0_00004 | RUNNING  |       |           16 |   32 |   32 | 0.00829854  |
| DEFAULT_155f0_00005 | RUNNING  |       |           16 |    4 |    4 | 0.00104528  |
| DEFAULT_155f0_00006 | RUNNING  |       |            2 |    4 |  128 | 0.000144118 |
| DEFAULT_155f0_00007 | RUNNING  |       |            2 |  256 |    8 | 0.00529693  |
| DEFAULT_155f0_00008 | RUNNING  |       |           16 |  128 |    4 | 0.000230149 |
| DEFAULT_155f0_00009 | RUNNING  |       |            4 |   16 |   64 | 0.00250992  |
+---------------------+----------+-------+--------------+------+------+-------------+


(ImplicitFunc pid=1896) Files already downloaded and verified
(ImplicitFunc pid=1891) Files already downloaded and verified
(ImplicitFunc pid=1895) Files already downloaded and verified
(ImplicitFunc pid=1893) Files already downloaded and verified
(ImplicitFunc pid=1831) Files already downloaded and verified
(ImplicitFunc pid=1879) Files already downloaded and verified
(ImplicitFunc pid=1864) Files already downloaded and verified
(ImplicitFunc pid=1860) Files already downloaded and verified
(ImplicitFunc pid=1842) Files already downloaded and verified
(ImplicitFunc pid=1827) Files already downloaded and verified
(ImplicitFunc pid=1896) Files already downloaded and verified
(ImplicitFunc pid=1891) Files already downloaded and verified
(ImplicitFunc pid=1895) Files already downloaded and verified
(ImplicitFunc pid=1893) Files already downloaded and verified
(ImplicitFunc pid=1831) Files already downloaded and verified
(ImplicitFunc pid=1879) Files already downloaded and verified
(ImplicitFunc pid=1864) Files already downloaded and verified
(ImplicitFunc pid=1860) Files already downloaded and verified
(ImplicitFunc pid=1842) Files already downloaded and verified
(ImplicitFunc pid=1827) Files already downloaded and verified
== Status ==
Memory usage on this node: 9.6/240.1 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 20.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (10 RUNNING)
+---------------------+----------+-------+--------------+------+------+-------------+
| Trial name          | status   | loc   |   batch_size |   l1 |   l2 |          lr |
|---------------------+----------+-------+--------------+------+------+-------------|
| DEFAULT_155f0_00000 | RUNNING  |       |            4 |   64 |  256 | 0.000408745 |
| DEFAULT_155f0_00001 | RUNNING  |       |            8 |   16 |  128 | 0.000189492 |
| DEFAULT_155f0_00002 | RUNNING  |       |            2 |  256 |  256 | 0.0109037   |
| DEFAULT_155f0_00003 | RUNNING  |       |            2 |   64 |  256 | 0.000324679 |
| DEFAULT_155f0_00004 | RUNNING  |       |           16 |   32 |   32 | 0.00829854  |
| DEFAULT_155f0_00005 | RUNNING  |       |           16 |    4 |    4 | 0.00104528  |
| DEFAULT_155f0_00006 | RUNNING  |       |            2 |    4 |  128 | 0.000144118 |
| DEFAULT_155f0_00007 | RUNNING  |       |            2 |  256 |    8 | 0.00529693  |
| DEFAULT_155f0_00008 | RUNNING  |       |           16 |  128 |    4 | 0.000230149 |
| DEFAULT_155f0_00009 | RUNNING  |       |            4 |   16 |   64 | 0.00250992  |
+---------------------+----------+-------+--------------+------+------+-------------+


== Status ==
Memory usage on this node: 9.7/240.1 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 20.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (10 RUNNING)
+---------------------+----------+-------+--------------+------+------+-------------+
| Trial name          | status   | loc   |   batch_size |   l1 |   l2 |          lr |
|---------------------+----------+-------+--------------+------+------+-------------|
| DEFAULT_155f0_00000 | RUNNING  |       |            4 |   64 |  256 | 0.000408745 |
| DEFAULT_155f0_00001 | RUNNING  |       |            8 |   16 |  128 | 0.000189492 |
| DEFAULT_155f0_00002 | RUNNING  |       |            2 |  256 |  256 | 0.0109037   |
| DEFAULT_155f0_00003 | RUNNING  |       |            2 |   64 |  256 | 0.000324679 |
| DEFAULT_155f0_00004 | RUNNING  |       |           16 |   32 |   32 | 0.00829854  |
| DEFAULT_155f0_00005 | RUNNING  |       |           16 |    4 |    4 | 0.00104528  |
| DEFAULT_155f0_00006 | RUNNING  |       |            2 |    4 |  128 | 0.000144118 |
| DEFAULT_155f0_00007 | RUNNING  |       |            2 |  256 |    8 | 0.00529693  |
| DEFAULT_155f0_00008 | RUNNING  |       |           16 |  128 |    4 | 0.000230149 |
| DEFAULT_155f0_00009 | RUNNING  |       |            4 |   16 |   64 | 0.00250992  |
+---------------------+----------+-------+--------------+------+------+-------------+


(ImplicitFunc pid=1842) [1,  2000] loss: 2.304
(ImplicitFunc pid=1896) [1,  2000] loss: 2.301
(ImplicitFunc pid=1891) [1,  2000] loss: 2.297
(ImplicitFunc pid=1879) [1,  2000] loss: 2.164
(ImplicitFunc pid=1827) [1,  2000] loss: 2.118
(ImplicitFunc pid=1893) [1,  2000] loss: 2.258
(ImplicitFunc pid=1895) [1,  2000] loss: 2.302
== Status ==
Memory usage on this node: 9.7/240.1 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 20.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (10 RUNNING)
+---------------------+----------+-------+--------------+------+------+-------------+
| Trial name          | status   | loc   |   batch_size |   l1 |   l2 |          lr |
|---------------------+----------+-------+--------------+------+------+-------------|
| DEFAULT_155f0_00000 | RUNNING  |       |            4 |   64 |  256 | 0.000408745 |
| DEFAULT_155f0_00001 | RUNNING  |       |            8 |   16 |  128 | 0.000189492 |
| DEFAULT_155f0_00002 | RUNNING  |       |            2 |  256 |  256 | 0.0109037   |
| DEFAULT_155f0_00003 | RUNNING  |       |            2 |   64 |  256 | 0.000324679 |
| DEFAULT_155f0_00004 | RUNNING  |       |           16 |   32 |   32 | 0.00829854  |
| DEFAULT_155f0_00005 | RUNNING  |       |           16 |    4 |    4 | 0.00104528  |
| DEFAULT_155f0_00006 | RUNNING  |       |            2 |    4 |  128 | 0.000144118 |
| DEFAULT_155f0_00007 | RUNNING  |       |            2 |  256 |    8 | 0.00529693  |
| DEFAULT_155f0_00008 | RUNNING  |       |           16 |  128 |    4 | 0.000230149 |
| DEFAULT_155f0_00009 | RUNNING  |       |            4 |   16 |   64 | 0.00250992  |
+---------------------+----------+-------+--------------+------+------+-------------+


(ImplicitFunc pid=1860) [1,  2000] loss: 2.225
(ImplicitFunc pid=1864) [1,  2000] loss: 1.765
(ImplicitFunc pid=1831) [1,  2000] loss: 2.319
== Status ==
Memory usage on this node: 9.6/240.1 GiB
Using AsyncHyperBand: num_stopped=0
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: None
Resources requested: 20.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (10 RUNNING)
+---------------------+----------+-------+--------------+------+------+-------------+
| Trial name          | status   | loc   |   batch_size |   l1 |   l2 |          lr |
|---------------------+----------+-------+--------------+------+------+-------------|
| DEFAULT_155f0_00000 | RUNNING  |       |            4 |   64 |  256 | 0.000408745 |
| DEFAULT_155f0_00001 | RUNNING  |       |            8 |   16 |  128 | 0.000189492 |
| DEFAULT_155f0_00002 | RUNNING  |       |            2 |  256 |  256 | 0.0109037   |
| DEFAULT_155f0_00003 | RUNNING  |       |            2 |   64 |  256 | 0.000324679 |
| DEFAULT_155f0_00004 | RUNNING  |       |           16 |   32 |   32 | 0.00829854  |
| DEFAULT_155f0_00005 | RUNNING  |       |           16 |    4 |    4 | 0.00104528  |
| DEFAULT_155f0_00006 | RUNNING  |       |            2 |    4 |  128 | 0.000144118 |
| DEFAULT_155f0_00007 | RUNNING  |       |            2 |  256 |    8 | 0.00529693  |
| DEFAULT_155f0_00008 | RUNNING  |       |           16 |  128 |    4 | 0.000230149 |
| DEFAULT_155f0_00009 | RUNNING  |       |            4 |   16 |   64 | 0.00250992  |
+---------------------+----------+-------+--------------+------+------+-------------+


(ImplicitFunc pid=1842) [1,  4000] loss: 1.152
(ImplicitFunc pid=1896) [1,  4000] loss: 1.108
(ImplicitFunc pid=1879) [1,  4000] loss: 1.022
(ImplicitFunc pid=1891) [1,  4000] loss: 1.053
(ImplicitFunc pid=1827) [1,  4000] loss: 0.881
Result for DEFAULT_155f0_00004:
  accuracy: 0.4608
  date: 2021-10-22_16-00-17
  done: false
  experiment_id: 150460f80f284dbbadc3cdf96878ea21
  hostname: 2ff84099b8fb
  iterations_since_restore: 1
  loss: 1.4752369190216064
  node_ip: 172.17.0.2
  pid: 1864
  should_checkpoint: true
  time_since_restore: 26.58752417564392
  time_this_iter_s: 26.58752417564392
  time_total_s: 26.58752417564392
  timestamp: 1634918417
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 155f0_00004

Result for DEFAULT_155f0_00005:
  accuracy: 0.2324
  date: 2021-10-22_16-00-17
  done: true
  experiment_id: 2f60989037d14f0e969d14eba44e2907
  hostname: 2ff84099b8fb
  iterations_since_restore: 1
  loss: 1.9137481538772583
  node_ip: 172.17.0.2
  pid: 1860
  should_checkpoint: true
  time_since_restore: 26.63590955734253
  time_this_iter_s: 26.63590955734253
  time_total_s: 26.63590955734253
  timestamp: 1634918417
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 155f0_00005

Result for DEFAULT_155f0_00008:
  accuracy: 0.1243
  date: 2021-10-22_16-00-17
  done: true
  experiment_id: 7d13e633af424ce884620dd4f7e64eb3
  hostname: 2ff84099b8fb
  iterations_since_restore: 1
  loss: 2.303878560256958
  node_ip: 172.17.0.2
  pid: 1831
  should_checkpoint: true
  time_since_restore: 27.35201644897461
  time_this_iter_s: 27.35201644897461
  time_total_s: 27.35201644897461
  timestamp: 1634918417
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 155f0_00008

(ImplicitFunc pid=1895) [1,  4000] loss: 1.143
== Status ==
Memory usage on this node: 8.5/240.1 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -1.9137481538772583
Resources requested: 16.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (8 RUNNING, 2 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    |                 |            4 |   64 |  256 | 0.000408745 |         |            |                      |
| DEFAULT_155f0_00001 | RUNNING    |                 |            8 |   16 |  128 | 0.000189492 |         |            |                      |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.47524 |     0.4608 |                    1 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    |                 |            4 |   16 |   64 | 0.00250992  |         |            |                      |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1893) [1,  4000] loss: 1.090
(ImplicitFunc pid=1842) [1,  6000] loss: 0.767
(ImplicitFunc pid=1896) [1,  6000] loss: 0.682
== Status ==
Memory usage on this node: 8.5/240.1 GiB
Using AsyncHyperBand: num_stopped=2
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -1.9137481538772583
Resources requested: 16.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (8 RUNNING, 2 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    |                 |            4 |   64 |  256 | 0.000408745 |         |            |                      |
| DEFAULT_155f0_00001 | RUNNING    |                 |            8 |   16 |  128 | 0.000189492 |         |            |                      |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.47524 |     0.4608 |                    1 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    |                 |            4 |   16 |   64 | 0.00250992  |         |            |                      |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1827) [1,  6000] loss: 0.556
(ImplicitFunc pid=1891) [1,  6000] loss: 0.637
(ImplicitFunc pid=1879) [1,  6000] loss: 0.673
Result for DEFAULT_155f0_00001:
  accuracy: 0.1715
  date: 2021-10-22_16-00-28
  done: true
  experiment_id: 6ac719670ade467c970f7374368947e4
  hostname: 2ff84099b8fb
  iterations_since_restore: 1
  loss: 2.181763638496399
  node_ip: 172.17.0.2
  pid: 1895
  should_checkpoint: true
  time_since_restore: 37.76892876625061
  time_this_iter_s: 37.76892876625061
  time_total_s: 37.76892876625061
  timestamp: 1634918428
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 155f0_00001

(ImplicitFunc pid=1864) [2,  2000] loss: 1.439
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -2.0477558961868287
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    |                 |            4 |   64 |  256 | 0.000408745 |         |            |                      |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.47524 |     0.4608 |                    1 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    |                 |            4 |   16 |   64 | 0.00250992  |         |            |                      |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1842) [1,  8000] loss: 0.573
(ImplicitFunc pid=1896) [1,  8000] loss: 0.490
(ImplicitFunc pid=1893) [1,  6000] loss: 0.741
(ImplicitFunc pid=1827) [1,  8000] loss: 0.403
(ImplicitFunc pid=1891) [1,  8000] loss: 0.436
(ImplicitFunc pid=1879) [1,  8000] loss: 0.505
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: None | Iter 1.000: -2.0477558961868287
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    |                 |            4 |   64 |  256 | 0.000408745 |         |            |                      |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.47524 |     0.4608 |                    1 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    |                 |            4 |   16 |   64 | 0.00250992  |         |            |                      |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00004:
  accuracy: 0.4948
  date: 2021-10-22_16-00-35
  done: false
  experiment_id: 150460f80f284dbbadc3cdf96878ea21
  hostname: 2ff84099b8fb
  iterations_since_restore: 2
  loss: 1.4219716433525085
  node_ip: 172.17.0.2
  pid: 1864
  should_checkpoint: true
  time_since_restore: 45.27180814743042
  time_this_iter_s: 18.6842839717865
  time_total_s: 45.27180814743042
  timestamp: 1634918435
  timesteps_since_restore: 0
  training_iteration: 2
  trial_id: 155f0_00004

(ImplicitFunc pid=1842) [1, 10000] loss: 0.445
(ImplicitFunc pid=1896) [1, 10000] loss: 0.370
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.4219716433525085 | Iter 1.000: -2.0477558961868287
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    |                 |            4 |   64 |  256 | 0.000408745 |         |            |                      |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.42197 |     0.4948 |                    2 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    |                 |            4 |   16 |   64 | 0.00250992  |         |            |                      |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1827) [1, 10000] loss: 0.313
(ImplicitFunc pid=1891) [1, 10000] loss: 0.327
(ImplicitFunc pid=1879) [1, 10000] loss: 0.400
(ImplicitFunc pid=1893) [1,  8000] loss: 0.552
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.4219716433525085 | Iter 1.000: -2.0477558961868287
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    |                 |            4 |   64 |  256 | 0.000408745 |         |            |                      |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.42197 |     0.4948 |                    2 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    |                 |            4 |   16 |   64 | 0.00250992  |         |            |                      |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1842) [1, 12000] loss: 0.353
(ImplicitFunc pid=1896) [1, 12000] loss: 0.295
Result for DEFAULT_155f0_00009:
  accuracy: 0.4231
  date: 2021-10-22_16-00-48
  done: false
  experiment_id: 987328491f264bf5be5f7af440c917c3
  hostname: 2ff84099b8fb
  iterations_since_restore: 1
  loss: 1.5886545635700227
  node_ip: 172.17.0.2
  pid: 1827
  should_checkpoint: true
  time_since_restore: 57.91948366165161
  time_this_iter_s: 57.91948366165161
  time_total_s: 57.91948366165161
  timestamp: 1634918448
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 155f0_00009

(ImplicitFunc pid=1864) [3,  2000] loss: 1.350
Result for DEFAULT_155f0_00000:
  accuracy: 0.4146
  date: 2021-10-22_16-00-49
  done: false
  experiment_id: 2b829cfa23d948beb082e488eae20065
  hostname: 2ff84099b8fb
  iterations_since_restore: 1
  loss: 1.5904938921928407
  node_ip: 172.17.0.2
  pid: 1891
  should_checkpoint: true
  time_since_restore: 59.225759744644165
  time_this_iter_s: 59.225759744644165
  time_total_s: 59.225759744644165
  timestamp: 1634918449
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 155f0_00000

== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.4219716433525085 | Iter 1.000: -1.7521210230350495
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    | 172.17.0.2:1891 |            4 |   64 |  256 | 0.000408745 | 1.59049 |     0.4146 |                    1 |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.42197 |     0.4948 |                    2 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    | 172.17.0.2:1827 |            4 |   16 |   64 | 0.00250992  | 1.58865 |     0.4231 |                    1 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1879) [1, 12000] loss: 0.332
(ImplicitFunc pid=1842) [1, 14000] loss: 0.287
Result for DEFAULT_155f0_00004:
  accuracy: 0.5306
  date: 2021-10-22_16-00-54
  done: false
  experiment_id: 150460f80f284dbbadc3cdf96878ea21
  hostname: 2ff84099b8fb
  iterations_since_restore: 3
  loss: 1.3246924286842345
  node_ip: 172.17.0.2
  pid: 1864
  should_checkpoint: true
  time_since_restore: 63.802223443984985
  time_this_iter_s: 18.530415296554565
  time_total_s: 63.802223443984985
  timestamp: 1634918454
  timesteps_since_restore: 0
  training_iteration: 3
  trial_id: 155f0_00004

(ImplicitFunc pid=1896) [1, 14000] loss: 0.241
(ImplicitFunc pid=1827) [2,  2000] loss: 1.497
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.4219716433525085 | Iter 1.000: -1.7521210230350495
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    | 172.17.0.2:1891 |            4 |   64 |  256 | 0.000408745 | 1.59049 |     0.4146 |                    1 |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.32469 |     0.5306 |                    3 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    | 172.17.0.2:1827 |            4 |   16 |   64 | 0.00250992  | 1.58865 |     0.4231 |                    1 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1893) [1, 10000] loss: 0.439
(ImplicitFunc pid=1891) [2,  2000] loss: 1.578
(ImplicitFunc pid=1842) [1, 16000] loss: 0.244
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.4219716433525085 | Iter 1.000: -1.7521210230350495
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    | 172.17.0.2:1891 |            4 |   64 |  256 | 0.000408745 | 1.59049 |     0.4146 |                    1 |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.32469 |     0.5306 |                    3 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    | 172.17.0.2:1827 |            4 |   16 |   64 | 0.00250992  | 1.58865 |     0.4231 |                    1 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1879) [1, 14000] loss: 0.288
(ImplicitFunc pid=1896) [1, 16000] loss: 0.206
(ImplicitFunc pid=1827) [2,  4000] loss: 0.761
(ImplicitFunc pid=1891) [2,  4000] loss: 0.766
(ImplicitFunc pid=1864) [4,  2000] loss: 1.304
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.4219716433525085 | Iter 1.000: -1.7521210230350495
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    | 172.17.0.2:1891 |            4 |   64 |  256 | 0.000408745 | 1.59049 |     0.4146 |                    1 |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.32469 |     0.5306 |                    3 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    | 172.17.0.2:1827 |            4 |   16 |   64 | 0.00250992  | 1.58865 |     0.4231 |                    1 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1842) [1, 18000] loss: 0.210
(ImplicitFunc pid=1896) [1, 18000] loss: 0.179
(ImplicitFunc pid=1893) [1, 12000] loss: 0.365
(ImplicitFunc pid=1879) [1, 16000] loss: 0.256
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: None | Iter 2.000: -1.4219716433525085 | Iter 1.000: -1.7521210230350495
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    | 172.17.0.2:1891 |            4 |   64 |  256 | 0.000408745 | 1.59049 |     0.4146 |                    1 |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.32469 |     0.5306 |                    3 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    | 172.17.0.2:1827 |            4 |   16 |   64 | 0.00250992  | 1.58865 |     0.4231 |                    1 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00004:
  accuracy: 0.527
  date: 2021-10-22_16-01-12
  done: false
  experiment_id: 150460f80f284dbbadc3cdf96878ea21
  hostname: 2ff84099b8fb
  iterations_since_restore: 4
  loss: 1.351849597454071
  node_ip: 172.17.0.2
  pid: 1864
  should_checkpoint: true
  time_since_restore: 81.87268018722534
  time_this_iter_s: 18.070456743240356
  time_total_s: 81.87268018722534
  timestamp: 1634918472
  timesteps_since_restore: 0
  training_iteration: 4
  trial_id: 155f0_00004

(ImplicitFunc pid=1827) [2,  6000] loss: 0.492
(ImplicitFunc pid=1891) [2,  6000] loss: 0.495
(ImplicitFunc pid=1842) [1, 20000] loss: 0.186
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4219716433525085 | Iter 1.000: -1.7521210230350495
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    | 172.17.0.2:1891 |            4 |   64 |  256 | 0.000408745 | 1.59049 |     0.4146 |                    1 |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.35185 |     0.527  |                    4 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    | 172.17.0.2:1827 |            4 |   16 |   64 | 0.00250992  | 1.58865 |     0.4231 |                    1 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [1, 20000] loss: 0.157
(ImplicitFunc pid=1879) [1, 18000] loss: 0.224
(ImplicitFunc pid=1827) [2,  8000] loss: 0.369
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4219716433525085 | Iter 1.000: -1.7521210230350495
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    | 172.17.0.2:1891 |            4 |   64 |  256 | 0.000408745 | 1.59049 |     0.4146 |                    1 |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.35185 |     0.527  |                    4 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    | 172.17.0.2:1827 |            4 |   16 |   64 | 0.00250992  | 1.58865 |     0.4231 |                    1 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1891) [2,  8000] loss: 0.368
(ImplicitFunc pid=1893) [1, 14000] loss: 0.305
(ImplicitFunc pid=1864) [5,  2000] loss: 1.261
== Status ==
Memory usage on this node: 7.9/240.1 GiB
Using AsyncHyperBand: num_stopped=3
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4219716433525085 | Iter 1.000: -1.7521210230350495
Resources requested: 14.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (7 RUNNING, 3 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    | 172.17.0.2:1891 |            4 |   64 |  256 | 0.000408745 | 1.59049 |     0.4146 |                    1 |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    |                 |            2 |   64 |  256 | 0.000324679 |         |            |                      |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.35185 |     0.527  |                    4 |
| DEFAULT_155f0_00006 | RUNNING    |                 |            2 |    4 |  128 | 0.000144118 |         |            |                      |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    | 172.17.0.2:1827 |            4 |   16 |   64 | 0.00250992  | 1.58865 |     0.4231 |                    1 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00006:
  accuracy: 0.2859
  date: 2021-10-22_16-01-28
  done: true
  experiment_id: 4fed98a8da1c4f8189af4b951b255b30
  hostname: 2ff84099b8fb
  iterations_since_restore: 1
  loss: 1.8548942442774772
  node_ip: 172.17.0.2
  pid: 1842
  should_checkpoint: true
  time_since_restore: 98.33216834068298
  time_this_iter_s: 98.33216834068298
  time_total_s: 98.33216834068298
  timestamp: 1634918488
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 155f0_00006

Result for DEFAULT_155f0_00003:
  accuracy: 0.4396
  date: 2021-10-22_16-01-30
  done: false
  experiment_id: 3233985c7910427b9ccff8df3603cf7a
  hostname: 2ff84099b8fb
  iterations_since_restore: 1
  loss: 1.5246975299537182
  node_ip: 172.17.0.2
  pid: 1896
  should_checkpoint: true
  time_since_restore: 100.16627240180969
  time_this_iter_s: 100.16627240180969
  time_total_s: 100.16627240180969
  timestamp: 1634918490
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 155f0_00003

(ImplicitFunc pid=1827) [2, 10000] loss: 0.293
Result for DEFAULT_155f0_00004:
  accuracy: 0.5288
  date: 2021-10-22_16-01-30
  done: false
  experiment_id: 150460f80f284dbbadc3cdf96878ea21
  hostname: 2ff84099b8fb
  iterations_since_restore: 5
  loss: 1.3357637036323546
  node_ip: 172.17.0.2
  pid: 1864
  should_checkpoint: true
  time_since_restore: 100.26883125305176
  time_this_iter_s: 18.396151065826416
  time_total_s: 100.26883125305176
  timestamp: 1634918490
  timesteps_since_restore: 0
  training_iteration: 5
  trial_id: 155f0_00004

(ImplicitFunc pid=1879) [1, 20000] loss: 0.201
(ImplicitFunc pid=1891) [2, 10000] loss: 0.288
== Status ==
Memory usage on this node: 7.3/240.1 GiB
Using AsyncHyperBand: num_stopped=4
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4219716433525085 | Iter 1.000: -1.722694068235159
Resources requested: 12.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (6 RUNNING, 4 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    | 172.17.0.2:1891 |            4 |   64 |  256 | 0.000408745 | 1.59049 |     0.4146 |                    1 |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.33576 |     0.5288 |                    5 |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00009 | RUNNING    | 172.17.0.2:1827 |            4 |   16 |   64 | 0.00250992  | 1.58865 |     0.4231 |                    1 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1893) [1, 16000] loss: 0.267
Result for DEFAULT_155f0_00009:
  accuracy: 0.4815
  date: 2021-10-22_16-01-37
  done: true
  experiment_id: 987328491f264bf5be5f7af440c917c3
  hostname: 2ff84099b8fb
  iterations_since_restore: 2
  loss: 1.4303198005378246
  node_ip: 172.17.0.2
  pid: 1827
  should_checkpoint: true
  time_since_restore: 106.52296757698059
  time_this_iter_s: 48.60348391532898
  time_total_s: 106.52296757698059
  timestamp: 1634918497
  timesteps_since_restore: 0
  training_iteration: 2
  trial_id: 155f0_00009

== Status ==
Memory usage on this node: 6.7/240.1 GiB
Using AsyncHyperBand: num_stopped=5
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.722694068235159
Resources requested: 10.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (5 RUNNING, 5 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | RUNNING    | 172.17.0.2:1891 |            4 |   64 |  256 | 0.000408745 | 1.59049 |     0.4146 |                    1 |
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.33576 |     0.5288 |                    5 |
| DEFAULT_155f0_00007 | RUNNING    |                 |            2 |  256 |    8 | 0.00529693  |         |            |                      |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [2,  2000] loss: 1.538
Result for DEFAULT_155f0_00000:
  accuracy: 0.4708
  date: 2021-10-22_16-01-39
  done: true
  experiment_id: 2b829cfa23d948beb082e488eae20065
  hostname: 2ff84099b8fb
  iterations_since_restore: 2
  loss: 1.459328824675083
  node_ip: 172.17.0.2
  pid: 1891
  should_checkpoint: true
  time_since_restore: 108.68354558944702
  time_this_iter_s: 49.457785844802856
  time_total_s: 108.68354558944702
  timestamp: 1634918499
  timesteps_since_restore: 0
  training_iteration: 2
  trial_id: 155f0_00000

Result for DEFAULT_155f0_00007:
  accuracy: 0.2322
  date: 2021-10-22_16-01-42
  done: true
  experiment_id: b7fe0eb1803944f3a7fe762d8d565c0c
  hostname: 2ff84099b8fb
  iterations_since_restore: 1
  loss: 2.032579603803158
  node_ip: 172.17.0.2
  pid: 1879
  should_checkpoint: true
  time_since_restore: 112.4920859336853
  time_this_iter_s: 112.4920859336853
  time_total_s: 112.4920859336853
  timestamp: 1634918502
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 155f0_00007

(ImplicitFunc pid=1864) [6,  2000] loss: 1.236
== Status ==
Memory usage on this node: 5.5/240.1 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8548942442774772
Resources requested: 6.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (3 RUNNING, 7 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.33576 |     0.5288 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [2,  4000] loss: 0.755
== Status ==
Memory usage on this node: 5.5/240.1 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8548942442774772
Resources requested: 6.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (3 RUNNING, 7 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.33576 |     0.5288 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00004:
  accuracy: 0.5405
  date: 2021-10-22_16-01-51
  done: false
  experiment_id: 150460f80f284dbbadc3cdf96878ea21
  hostname: 2ff84099b8fb
  iterations_since_restore: 6
  loss: 1.3177977504730225
  node_ip: 172.17.0.2
  pid: 1864
  should_checkpoint: true
  time_since_restore: 121.4858992099762
  time_this_iter_s: 21.21706795692444
  time_total_s: 121.4858992099762
  timestamp: 1634918511
  timesteps_since_restore: 0
  training_iteration: 6
  trial_id: 155f0_00004

(ImplicitFunc pid=1893) [1, 18000] loss: 0.239
== Status ==
Memory usage on this node: 5.5/240.1 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8548942442774772
Resources requested: 6.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (3 RUNNING, 7 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.3178  |     0.5405 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [2,  6000] loss: 0.491
== Status ==
Memory usage on this node: 5.5/240.1 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8548942442774772
Resources requested: 6.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (3 RUNNING, 7 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.3178  |     0.5405 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [2,  8000] loss: 0.374
(ImplicitFunc pid=1864) [7,  2000] loss: 1.223
(ImplicitFunc pid=1893) [1, 20000] loss: 0.218
== Status ==
Memory usage on this node: 5.5/240.1 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8548942442774772
Resources requested: 6.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (3 RUNNING, 7 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.3178  |     0.5405 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00004:
  accuracy: 0.5478
  date: 2021-10-22_16-02-08
  done: false
  experiment_id: 150460f80f284dbbadc3cdf96878ea21
  hostname: 2ff84099b8fb
  iterations_since_restore: 7
  loss: 1.2904102920532226
  node_ip: 172.17.0.2
  pid: 1864
  should_checkpoint: true
  time_since_restore: 138.24196434020996
  time_this_iter_s: 16.756065130233765
  time_total_s: 138.24196434020996
  timestamp: 1634918528
  timesteps_since_restore: 0
  training_iteration: 7
  trial_id: 155f0_00004

(ImplicitFunc pid=1896) [2, 10000] loss: 0.288
== Status ==
Memory usage on this node: 5.5/240.1 GiB
Using AsyncHyperBand: num_stopped=7
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8548942442774772
Resources requested: 6.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (3 RUNNING, 7 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00002 | RUNNING    |                 |            2 |  256 |  256 | 0.0109037   |         |            |                      |
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.29041 |     0.5478 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00002:
  accuracy: 0.1932
  date: 2021-10-22_16-02-14
  done: true
  experiment_id: 1c7737f5c577429e9afba1e1baf9bb8c
  hostname: 2ff84099b8fb
  iterations_since_restore: 1
  loss: 2.175864242947102
  node_ip: 172.17.0.2
  pid: 1893
  should_checkpoint: true
  time_since_restore: 144.43001294136047
  time_this_iter_s: 144.43001294136047
  time_total_s: 144.43001294136047
  timestamp: 1634918534
  timesteps_since_restore: 0
  training_iteration: 1
  trial_id: 155f0_00002

== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.29041 |     0.5478 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [2, 12000] loss: 0.245
(ImplicitFunc pid=1864) [8,  2000] loss: 1.211
== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.29041 |     0.5478 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.29041 |     0.5478 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.29041 |     0.5478 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [2, 14000] loss: 0.205
== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: None | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.29041 |     0.5478 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00004:
  accuracy: 0.5601
  date: 2021-10-22_16-02-36
  done: false
  experiment_id: 150460f80f284dbbadc3cdf96878ea21
  hostname: 2ff84099b8fb
  iterations_since_restore: 8
  loss: 1.2845474182128906
  node_ip: 172.17.0.2
  pid: 1864
  should_checkpoint: true
  time_since_restore: 165.6271734237671
  time_this_iter_s: 27.38520908355713
  time_total_s: 165.6271734237671
  timestamp: 1634918556
  timesteps_since_restore: 0
  training_iteration: 8
  trial_id: 155f0_00004

== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.28455 |     0.5601 |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [2, 16000] loss: 0.177
== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.28455 |     0.5601 |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1864) [9,  2000] loss: 1.198
(ImplicitFunc pid=1896) [2, 18000] loss: 0.153
== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.28455 |     0.5601 |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00004:
  accuracy: 0.5608
  date: 2021-10-22_16-02-52
  done: false
  experiment_id: 150460f80f284dbbadc3cdf96878ea21
  hostname: 2ff84099b8fb
  iterations_since_restore: 9
  loss: 1.2861367955207825
  node_ip: 172.17.0.2
  pid: 1864
  should_checkpoint: true
  time_since_restore: 182.16795682907104
  time_this_iter_s: 16.540783405303955
  time_total_s: 182.16795682907104
  timestamp: 1634918572
  timesteps_since_restore: 0
  training_iteration: 9
  trial_id: 155f0_00004

(ImplicitFunc pid=1896) [2, 20000] loss: 0.136
== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.28614 |     0.5608 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4303198005378246 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.5247  |     0.4396 |                    1 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.28614 |     0.5608 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1864) [10,  2000] loss: 1.192
Result for DEFAULT_155f0_00003:
  accuracy: 0.5129
  date: 2021-10-22_16-03-06
  done: false
  experiment_id: 3233985c7910427b9ccff8df3603cf7a
  hostname: 2ff84099b8fb
  iterations_since_restore: 2
  loss: 1.3504374861903488
  node_ip: 172.17.0.2
  pid: 1896
  should_checkpoint: true
  time_since_restore: 195.68697714805603
  time_this_iter_s: 95.52070474624634
  time_total_s: 195.68697714805603
  timestamp: 1634918586
  timesteps_since_restore: 0
  training_iteration: 2
  trial_id: 155f0_00003

== Status ==
Memory usage on this node: 4.9/240.1 GiB
Using AsyncHyperBand: num_stopped=8
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 4.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (2 RUNNING, 8 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00004 | RUNNING    | 172.17.0.2:1864 |           16 |   32 |   32 | 0.00829854  | 1.28614 |     0.5608 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00004:
  accuracy: 0.5575
  date: 2021-10-22_16-03-09
  done: true
  experiment_id: 150460f80f284dbbadc3cdf96878ea21
  hostname: 2ff84099b8fb
  iterations_since_restore: 10
  loss: 1.3445505316734314
  node_ip: 172.17.0.2
  pid: 1864
  should_checkpoint: true
  time_since_restore: 198.8587715625763
  time_this_iter_s: 16.69081473350525
  time_total_s: 198.8587715625763
  timestamp: 1634918589
  timesteps_since_restore: 0
  training_iteration: 10
  trial_id: 155f0_00004

== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [3,  2000] loss: 1.341
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [3,  4000] loss: 0.664
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [3,  6000] loss: 0.445
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [3,  8000] loss: 0.334
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [3, 10000] loss: 0.261
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [3, 12000] loss: 0.219
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [3, 14000] loss: 0.181
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [3, 16000] loss: 0.159
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [3, 18000] loss: 0.138
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [3, 20000] loss: 0.129
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.35044 |     0.5129 |                    2 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00003:
  accuracy: 0.5586
  date: 2021-10-22_16-04-21
  done: false
  experiment_id: 3233985c7910427b9ccff8df3603cf7a
  hostname: 2ff84099b8fb
  iterations_since_restore: 3
  loss: 1.2336595372421666
  node_ip: 172.17.0.2
  pid: 1896
  should_checkpoint: true
  time_since_restore: 271.4593186378479
  time_this_iter_s: 75.77234148979187
  time_total_s: 271.4593186378479
  timestamp: 1634918661
  timesteps_since_restore: 0
  training_iteration: 3
  trial_id: 155f0_00003

== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [4,  2000] loss: 1.201
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [4,  4000] loss: 0.609
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [4,  6000] loss: 0.409
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [4,  8000] loss: 0.304
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [4, 10000] loss: 0.240
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [4, 12000] loss: 0.203
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [4, 14000] loss: 0.170
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [4, 16000] loss: 0.151
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [4, 18000] loss: 0.134
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [4, 20000] loss: 0.118
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.351849597454071 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.23366 |     0.5586 |                    3 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00003:
  accuracy: 0.5722
  date: 2021-10-22_16-05-37
  done: false
  experiment_id: 3233985c7910427b9ccff8df3603cf7a
  hostname: 2ff84099b8fb
  iterations_since_restore: 4
  loss: 1.2154709118615836
  node_ip: 172.17.0.2
  pid: 1896
  should_checkpoint: true
  time_since_restore: 347.501788854599
  time_this_iter_s: 76.0424702167511
  time_total_s: 347.501788854599
  timestamp: 1634918737
  timesteps_since_restore: 0
  training_iteration: 4
  trial_id: 155f0_00003

== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [5,  2000] loss: 1.157
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [5,  4000] loss: 0.558
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [5,  6000] loss: 0.386
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [5,  8000] loss: 0.283
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [5, 10000] loss: 0.227
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [5, 12000] loss: 0.188
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [5, 14000] loss: 0.162
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [5, 16000] loss: 0.144
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [5, 18000] loss: 0.126
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [5, 20000] loss: 0.111
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21547 |     0.5722 |                    4 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00003:
  accuracy: 0.5824
  date: 2021-10-22_16-06-55
  done: false
  experiment_id: 3233985c7910427b9ccff8df3603cf7a
  hostname: 2ff84099b8fb
  iterations_since_restore: 5
  loss: 1.1752136316115036
  node_ip: 172.17.0.2
  pid: 1896
  should_checkpoint: true
  time_since_restore: 424.7314417362213
  time_this_iter_s: 77.22965288162231
  time_total_s: 424.7314417362213
  timestamp: 1634918815
  timesteps_since_restore: 0
  training_iteration: 5
  trial_id: 155f0_00003

== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [6,  2000] loss: 1.060
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [6,  4000] loss: 0.525
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [6,  6000] loss: 0.360
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [6,  8000] loss: 0.277
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [6, 10000] loss: 0.219
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [6, 12000] loss: 0.180
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [6, 14000] loss: 0.158
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [6, 16000] loss: 0.137
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+

(ImplicitFunc pid=1896) [6, 18000] loss: 0.120

== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [6, 20000] loss: 0.108
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.17521 |     0.5824 |                    5 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00003:
  accuracy: 0.5768
  date: 2021-10-22_16-08-10
  done: false
  experiment_id: 3233985c7910427b9ccff8df3603cf7a
  hostname: 2ff84099b8fb
  iterations_since_restore: 6
  loss: 1.2156212288672221
  node_ip: 172.17.0.2
  pid: 1896
  should_checkpoint: true
  time_since_restore: 500.35039830207825
  time_this_iter_s: 75.61895656585693
  time_total_s: 500.35039830207825
  timestamp: 1634918890
  timesteps_since_restore: 0
  training_iteration: 6
  trial_id: 155f0_00003

== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [7,  2000] loss: 1.011
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [7,  4000] loss: 0.502
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [7,  6000] loss: 0.342
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [7,  8000] loss: 0.259
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [7, 10000] loss: 0.209
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [7, 12000] loss: 0.171
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [7, 14000] loss: 0.147
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [7, 16000] loss: 0.130
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [7, 18000] loss: 0.112
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [7, 20000] loss: 0.105
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.21562 |     0.5768 |                    6 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00003:
  accuracy: 0.6052
  date: 2021-10-22_16-09-27
  done: false
  experiment_id: 3233985c7910427b9ccff8df3603cf7a
  hostname: 2ff84099b8fb
  iterations_since_restore: 7
  loss: 1.1410461066515591
  node_ip: 172.17.0.2
  pid: 1896
  should_checkpoint: true
  time_since_restore: 576.8596670627594
  time_this_iter_s: 76.50926876068115
  time_total_s: 576.8596670627594
  timestamp: 1634918967
  timesteps_since_restore: 0
  training_iteration: 7
  trial_id: 155f0_00003

== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [8,  2000] loss: 0.938
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [8,  4000] loss: 0.479
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [8,  6000] loss: 0.340
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [8,  8000] loss: 0.249
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [8, 10000] loss: 0.199
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [8, 12000] loss: 0.164
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [8, 14000] loss: 0.143
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [8, 16000] loss: 0.123
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [8, 18000] loss: 0.112
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [8, 20000] loss: 0.102
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2845474182128906 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.14105 |     0.6052 |                    7 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00003:
  accuracy: 0.608
  date: 2021-10-22_16-10-44
  done: false
  experiment_id: 3233985c7910427b9ccff8df3603cf7a
  hostname: 2ff84099b8fb
  iterations_since_restore: 8
  loss: 1.1330271839099237
  node_ip: 172.17.0.2
  pid: 1896
  should_checkpoint: true
  time_since_restore: 653.813309431076
  time_this_iter_s: 76.95364236831665
  time_total_s: 653.813309431076
  timestamp: 1634919044
  timesteps_since_restore: 0
  training_iteration: 8
  trial_id: 155f0_00003

== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [9,  2000] loss: 0.920
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [9,  4000] loss: 0.465
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [9,  6000] loss: 0.317
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [9,  8000] loss: 0.240
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [9, 10000] loss: 0.192
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [9, 12000] loss: 0.162
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [9, 14000] loss: 0.133
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [9, 16000] loss: 0.120
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [9, 18000] loss: 0.110
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [9, 20000] loss: 0.096
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.13303 |     0.608  |                    8 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00003:
  accuracy: 0.6094
  date: 2021-10-22_16-12-00
  done: false
  experiment_id: 3233985c7910427b9ccff8df3603cf7a
  hostname: 2ff84099b8fb
  iterations_since_restore: 9
  loss: 1.1138853812555316
  node_ip: 172.17.0.2
  pid: 1896
  should_checkpoint: true
  time_since_restore: 730.3297266960144
  time_this_iter_s: 76.51641726493835
  time_total_s: 730.3297266960144
  timestamp: 1634919120
  timesteps_since_restore: 0
  training_iteration: 9
  trial_id: 155f0_00003

== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [10,  2000] loss: 0.886
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [10,  4000] loss: 0.437
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [10,  6000] loss: 0.317
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [10,  8000] loss: 0.225
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [10, 10000] loss: 0.188
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [10, 12000] loss: 0.154
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [10, 14000] loss: 0.132
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [10, 16000] loss: 0.114
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [10, 18000] loss: 0.105
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


(ImplicitFunc pid=1896) [10, 20000] loss: 0.091
== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


== Status ==
Memory usage on this node: 4.3/240.1 GiB
Using AsyncHyperBand: num_stopped=9
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 2.0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (1 RUNNING, 9 TERMINATED)
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc             |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00003 | RUNNING    | 172.17.0.2:1896 |            2 |   64 |  256 | 0.000324679 | 1.11389 |     0.6094 |                    9 |
| DEFAULT_155f0_00000 | TERMINATED |                 |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |                 |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |                 |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00004 | TERMINATED |                 |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |                 |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |                 |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |                 |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |                 |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |                 |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-----------------+--------------+------+------+-------------+---------+------------+----------------------+


Result for DEFAULT_155f0_00003:
  accuracy: 0.6219
  date: 2021-10-22_16-13-17
  done: true
  experiment_id: 3233985c7910427b9ccff8df3603cf7a
  hostname: 2ff84099b8fb
  iterations_since_restore: 10
  loss: 1.1142561709050818
  node_ip: 172.17.0.2
  pid: 1896
  should_checkpoint: true
  time_since_restore: 807.3038601875305
  time_this_iter_s: 76.97413349151611
  time_total_s: 807.3038601875305
  timestamp: 1634919197
  timesteps_since_restore: 0
  training_iteration: 10
  trial_id: 155f0_00003

== Status ==
Memory usage on this node: 3.8/240.1 GiB
Using AsyncHyperBand: num_stopped=10
Bracket: Iter 8.000: -1.2087873010614072 | Iter 4.000: -1.2836602546578273 | Iter 2.000: -1.4261457219451665 | Iter 1.000: -1.8843211990773678
Resources requested: 0/32 CPUs, 0/2 GPUs, 0.0/220.13 GiB heap, 0.0/9.31 GiB objects (0.0/1.0 accelerator_type:M60)
Result logdir: /var/lib/jenkins/ray_results/DEFAULT_2021-10-22_15-59-48
Number of trials: 10/10 (10 TERMINATED)
+---------------------+------------+-------+--------------+------+------+-------------+---------+------------+----------------------+
| Trial name          | status     | loc   |   batch_size |   l1 |   l2 |          lr |    loss |   accuracy |   training_iteration |
|---------------------+------------+-------+--------------+------+------+-------------+---------+------------+----------------------|
| DEFAULT_155f0_00000 | TERMINATED |       |            4 |   64 |  256 | 0.000408745 | 1.45933 |     0.4708 |                    2 |
| DEFAULT_155f0_00001 | TERMINATED |       |            8 |   16 |  128 | 0.000189492 | 2.18176 |     0.1715 |                    1 |
| DEFAULT_155f0_00002 | TERMINATED |       |            2 |  256 |  256 | 0.0109037   | 2.17586 |     0.1932 |                    1 |
| DEFAULT_155f0_00003 | TERMINATED |       |            2 |   64 |  256 | 0.000324679 | 1.11426 |     0.6219 |                   10 |
| DEFAULT_155f0_00004 | TERMINATED |       |           16 |   32 |   32 | 0.00829854  | 1.34455 |     0.5575 |                   10 |
| DEFAULT_155f0_00005 | TERMINATED |       |           16 |    4 |    4 | 0.00104528  | 1.91375 |     0.2324 |                    1 |
| DEFAULT_155f0_00006 | TERMINATED |       |            2 |    4 |  128 | 0.000144118 | 1.85489 |     0.2859 |                    1 |
| DEFAULT_155f0_00007 | TERMINATED |       |            2 |  256 |    8 | 0.00529693  | 2.03258 |     0.2322 |                    1 |
| DEFAULT_155f0_00008 | TERMINATED |       |           16 |  128 |    4 | 0.000230149 | 2.30388 |     0.1243 |                    1 |
| DEFAULT_155f0_00009 | TERMINATED |       |            4 |   16 |   64 | 0.00250992  | 1.43032 |     0.4815 |                    2 |
+---------------------+------------+-------+--------------+------+------+-------------+---------+------------+----------------------+


Best trial config: {'l1': 64, 'l2': 256, 'lr': 0.00032467912973230994, 'batch_size': 2}
Best trial final validation loss: 1.1142561709050818
Best trial final validation accuracy: 0.6219
Files already downloaded and verified
Files already downloaded and verified
Best trial test set accuracy: 0.6157

If you run the code, an example output could look like this:

Number of trials: 10 (10 TERMINATED)
+-----+------+------+-------------+--------------+---------+------------+--------------------+
| ... |   l1 |   l2 |          lr |   batch_size |    loss |   accuracy | training_iteration |
|-----+------+------+-------------+--------------+---------+------------+--------------------|
| ... |   64 |    4 | 0.00011629  |            2 | 1.87273 |     0.244  |                  2 |
| ... |   32 |   64 | 0.000339763 |            8 | 1.23603 |     0.567  |                  8 |
| ... |    8 |   16 | 0.00276249  |           16 | 1.1815  |     0.5836 |                 10 |
| ... |    4 |   64 | 0.000648721 |            4 | 1.31131 |     0.5224 |                  8 |
| ... |   32 |   16 | 0.000340753 |            8 | 1.26454 |     0.5444 |                  8 |
| ... |    8 |    4 | 0.000699775 |            8 | 1.99594 |     0.1983 |                  2 |
| ... |  256 |    8 | 0.0839654   |           16 | 2.3119  |     0.0993 |                  1 |
| ... |   16 |  128 | 0.0758154   |           16 | 2.33575 |     0.1327 |                  1 |
| ... |   16 |    8 | 0.0763312   |           16 | 2.31129 |     0.1042 |                  4 |
| ... |  128 |   16 | 0.000124903 |            4 | 2.26917 |     0.1945 |                  1 |
+-----+------+------+-------------+--------------+---------+------------+--------------------+


Best trial config: {'l1': 8, 'l2': 16, 'lr': 0.00276249, 'batch_size': 16, 'data_dir': '...'}
Best trial final validation loss: 1.181501
Best trial final validation accuracy: 0.5836
Best trial test set accuracy: 0.5806

Most trials have been stopped early in order to avoid wasting resources. The best performing trial achieved a validation accuracy of about 58%, which could be confirmed on the test set.

So that’s it! You can now tune the parameters of your PyTorch models.

Total running time of the script: ( 13 minutes 51.173 seconds)

Gallery generated by Sphinx-Gallery

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources