&&&& RUNNING TensorRT.sample_onnx_mnist # ./sample_onnx_mnist [06/13/2021-16:48:57] [I] ******* MY initializeSampleParams: params.onnxFileName = yolov4_1_3_512_512_static.onnx [06/13/2021-16:48:57] [I] Building and running a GPU inference engine for Onnx MNIST [06/13/2021-16:48:57] [I] **************** build() ************************ [06/13/2021-16:48:57] [I] ******** constructNetwork() parseFromFile() ****************** ---------------------------------------------------------------- Input filename: ../../../data/mnist/yolov4_1_3_512_512_static.onnx ONNX IR version: 0.0.6 Opset version: 11 Producer name: pytorch Producer version: 1.7 Domain: Model version: 0 Doc string: ---------------------------------------------------------------- [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::Proposal version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::Split version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:202: Adding network input: input with dtype: float32, dimensions: (1, 3, 512, 512) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: input for ONNX tensor: input [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2401 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2402 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2404 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2405 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2407 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2408 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2410 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2411 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2413 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2414 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2416 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2417 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2419 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2420 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2422 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2423 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2425 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2426 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2428 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2429 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2431 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2432 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2434 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2435 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2437 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2438 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2440 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2441 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2443 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2444 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2446 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2447 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2449 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2450 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2452 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2453 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2455 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2456 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2458 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2459 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2461 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2462 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2464 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2465 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2467 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2468 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2470 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2471 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2473 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2474 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2476 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2477 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2479 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2480 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2482 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2483 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2485 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2486 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2488 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2489 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2491 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2492 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2494 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2495 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2497 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2498 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2500 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2501 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2503 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2504 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2506 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2507 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2509 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2510 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2512 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2513 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2515 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2516 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2518 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2519 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2521 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2522 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2524 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2525 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2527 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2528 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2530 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2531 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2533 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2534 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2536 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2537 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2539 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2540 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2542 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2543 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2545 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2546 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2548 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2549 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2551 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2552 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2554 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2555 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2557 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2558 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2560 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2561 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2563 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2564 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2566 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2567 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2569 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2570 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2572 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2573 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2575 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2576 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2578 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2579 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2581 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2582 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2584 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2585 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2587 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2588 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2590 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2591 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2593 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2594 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2596 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2597 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2599 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2600 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2602 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2603 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2605 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2606 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2608 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2609 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2611 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2612 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2614 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2615 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2617 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2618 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2620 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2621 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2623 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2624 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2626 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2627 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2629 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2630 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2632 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2633 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2635 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2636 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2638 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2639 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2641 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2642 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2645 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2647 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2648 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2650 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2651 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2653 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2654 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2656 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2657 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2659 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2660 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2662 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2663 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2665 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2666 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2668 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2669 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2671 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2672 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2674 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2675 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2677 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2678 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2680 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2681 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2683 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2684 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2686 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2687 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2689 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2690 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2692 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2693 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2695 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2696 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2698 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2699 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2701 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2702 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2704 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2705 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2707 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2708 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2710 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2711 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2713 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2714 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2716 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2717 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2719 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2720 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2721 [06/13/2021-16:48:57] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2722 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2723 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2724 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2725 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2726 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2727 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2728 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2729 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2730 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2731 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2732 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2733 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2734 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2735 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2736 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2737 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2738 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2739 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2740 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2741 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2742 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2743 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2744 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2745 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2746 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2747 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2748 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2749 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2750 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2751 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2752 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2753 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2754 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2755 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2756 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2757 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 2758 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: models.138.conv94.bias [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: models.138.conv94.weight [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: models.149.conv102.bias [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: models.149.conv102.weight [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: models.160.conv110.bias [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:90: Importing initializer: models.160.conv110.weight [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_0 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: input [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2401 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2402 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_0 [Conv] inputs: [input -> (1, 3, 512, 512)], [2401 -> (32, 3, 3, 3)], [2402 -> (32)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 3, 512, 512) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_0 for ONNX node: Conv_0 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 32, 512, 512) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2400 for ONNX tensor: 2400 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_0 [Conv] outputs: [2400 -> (1, 32, 512, 512)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_1 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2400 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_1 [Softplus] inputs: [2400 -> (1, 32, 512, 512)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_1 for ONNX node: Softplus_1 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 651 for ONNX tensor: 651 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_1 [Softplus] outputs: [651 -> (1, 32, 512, 512)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_2 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 651 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_2 [Tanh] inputs: [651 -> (1, 32, 512, 512)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_2 for ONNX node: Tanh_2 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 652 for ONNX tensor: 652 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_2 [Tanh] outputs: [652 -> (1, 32, 512, 512)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_3 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2400 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 652 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_3 [Mul] inputs: [2400 -> (1, 32, 512, 512)], [652 -> (1, 32, 512, 512)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_3 for ONNX node: Mul_3 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 653 for ONNX tensor: 653 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_3 [Mul] outputs: [653 -> (1, 32, 512, 512)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_4 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 653 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2404 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2405 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_4 [Conv] inputs: [653 -> (1, 32, 512, 512)], [2404 -> (64, 32, 3, 3)], [2405 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 32, 512, 512) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_4 for ONNX node: Conv_4 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2403 for ONNX tensor: 2403 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_4 [Conv] outputs: [2403 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_5 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2403 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_5 [Softplus] inputs: [2403 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_5 for ONNX node: Softplus_5 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 656 for ONNX tensor: 656 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_5 [Softplus] outputs: [656 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_6 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 656 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_6 [Tanh] inputs: [656 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_6 for ONNX node: Tanh_6 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 657 for ONNX tensor: 657 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_6 [Tanh] outputs: [657 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_7 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2403 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 657 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_7 [Mul] inputs: [2403 -> (1, 64, 256, 256)], [657 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_7 for ONNX node: Mul_7 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 658 for ONNX tensor: 658 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_7 [Mul] outputs: [658 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_8 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 658 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2407 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2408 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_8 [Conv] inputs: [658 -> (1, 64, 256, 256)], [2407 -> (64, 64, 1, 1)], [2408 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_8 for ONNX node: Conv_8 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2406 for ONNX tensor: 2406 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_8 [Conv] outputs: [2406 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_9 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2406 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_9 [Softplus] inputs: [2406 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_9 for ONNX node: Softplus_9 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 661 for ONNX tensor: 661 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_9 [Softplus] outputs: [661 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_10 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 661 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_10 [Tanh] inputs: [661 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_10 for ONNX node: Tanh_10 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 662 for ONNX tensor: 662 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_10 [Tanh] outputs: [662 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_11 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2406 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 662 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_11 [Mul] inputs: [2406 -> (1, 64, 256, 256)], [662 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_11 for ONNX node: Mul_11 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 663 for ONNX tensor: 663 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_11 [Mul] outputs: [663 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_12 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 658 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2410 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2411 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_12 [Conv] inputs: [658 -> (1, 64, 256, 256)], [2410 -> (64, 64, 1, 1)], [2411 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_12 for ONNX node: Conv_12 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2409 for ONNX tensor: 2409 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_12 [Conv] outputs: [2409 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_13 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2409 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_13 [Softplus] inputs: [2409 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_13 for ONNX node: Softplus_13 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 666 for ONNX tensor: 666 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_13 [Softplus] outputs: [666 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_14 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 666 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_14 [Tanh] inputs: [666 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_14 for ONNX node: Tanh_14 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 667 for ONNX tensor: 667 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_14 [Tanh] outputs: [667 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_15 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2409 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 667 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_15 [Mul] inputs: [2409 -> (1, 64, 256, 256)], [667 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_15 for ONNX node: Mul_15 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 668 for ONNX tensor: 668 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_15 [Mul] outputs: [668 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_16 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 668 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2413 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2414 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_16 [Conv] inputs: [668 -> (1, 64, 256, 256)], [2413 -> (32, 64, 1, 1)], [2414 -> (32)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_16 for ONNX node: Conv_16 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 32, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2412 for ONNX tensor: 2412 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_16 [Conv] outputs: [2412 -> (1, 32, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_17 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2412 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_17 [Softplus] inputs: [2412 -> (1, 32, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_17 for ONNX node: Softplus_17 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 671 for ONNX tensor: 671 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_17 [Softplus] outputs: [671 -> (1, 32, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_18 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 671 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_18 [Tanh] inputs: [671 -> (1, 32, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_18 for ONNX node: Tanh_18 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 672 for ONNX tensor: 672 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_18 [Tanh] outputs: [672 -> (1, 32, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_19 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2412 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 672 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_19 [Mul] inputs: [2412 -> (1, 32, 256, 256)], [672 -> (1, 32, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_19 for ONNX node: Mul_19 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 673 for ONNX tensor: 673 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_19 [Mul] outputs: [673 -> (1, 32, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_20 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 673 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2416 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2417 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_20 [Conv] inputs: [673 -> (1, 32, 256, 256)], [2416 -> (64, 32, 3, 3)], [2417 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 32, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_20 for ONNX node: Conv_20 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2415 for ONNX tensor: 2415 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_20 [Conv] outputs: [2415 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_21 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2415 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_21 [Softplus] inputs: [2415 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_21 for ONNX node: Softplus_21 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 676 for ONNX tensor: 676 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_21 [Softplus] outputs: [676 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_22 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 676 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_22 [Tanh] inputs: [676 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_22 for ONNX node: Tanh_22 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 677 for ONNX tensor: 677 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_22 [Tanh] outputs: [677 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_23 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2415 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 677 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_23 [Mul] inputs: [2415 -> (1, 64, 256, 256)], [677 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_23 for ONNX node: Mul_23 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 678 for ONNX tensor: 678 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_23 [Mul] outputs: [678 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_24 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 668 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 678 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_24 [Add] inputs: [668 -> (1, 64, 256, 256)], [678 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_24 for ONNX node: Add_24 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 679 for ONNX tensor: 679 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_24 [Add] outputs: [679 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_25 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 679 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2419 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2420 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_25 [Conv] inputs: [679 -> (1, 64, 256, 256)], [2419 -> (64, 64, 1, 1)], [2420 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_25 for ONNX node: Conv_25 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2418 for ONNX tensor: 2418 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_25 [Conv] outputs: [2418 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_26 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2418 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_26 [Softplus] inputs: [2418 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_26 for ONNX node: Softplus_26 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 682 for ONNX tensor: 682 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_26 [Softplus] outputs: [682 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_27 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 682 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_27 [Tanh] inputs: [682 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_27 for ONNX node: Tanh_27 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 683 for ONNX tensor: 683 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_27 [Tanh] outputs: [683 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_28 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2418 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 683 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_28 [Mul] inputs: [2418 -> (1, 64, 256, 256)], [683 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_28 for ONNX node: Mul_28 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 684 for ONNX tensor: 684 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_28 [Mul] outputs: [684 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_29 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 684 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 663 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_29 [Concat] inputs: [684 -> (1, 64, 256, 256)], [663 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_29 for ONNX node: Concat_29 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 685 for ONNX tensor: 685 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_29 [Concat] outputs: [685 -> (1, 128, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_30 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 685 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2422 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2423 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_30 [Conv] inputs: [685 -> (1, 128, 256, 256)], [2422 -> (64, 128, 1, 1)], [2423 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_30 for ONNX node: Conv_30 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2421 for ONNX tensor: 2421 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_30 [Conv] outputs: [2421 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_31 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2421 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_31 [Softplus] inputs: [2421 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_31 for ONNX node: Softplus_31 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 688 for ONNX tensor: 688 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_31 [Softplus] outputs: [688 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_32 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 688 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_32 [Tanh] inputs: [688 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_32 for ONNX node: Tanh_32 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 689 for ONNX tensor: 689 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_32 [Tanh] outputs: [689 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_33 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2421 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 689 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_33 [Mul] inputs: [2421 -> (1, 64, 256, 256)], [689 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_33 for ONNX node: Mul_33 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 690 for ONNX tensor: 690 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_33 [Mul] outputs: [690 -> (1, 64, 256, 256)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_34 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 690 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2425 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2426 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_34 [Conv] inputs: [690 -> (1, 64, 256, 256)], [2425 -> (128, 64, 3, 3)], [2426 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 64, 256, 256) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_34 for ONNX node: Conv_34 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2424 for ONNX tensor: 2424 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_34 [Conv] outputs: [2424 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_35 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2424 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_35 [Softplus] inputs: [2424 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_35 for ONNX node: Softplus_35 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 693 for ONNX tensor: 693 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_35 [Softplus] outputs: [693 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_36 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 693 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_36 [Tanh] inputs: [693 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_36 for ONNX node: Tanh_36 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 694 for ONNX tensor: 694 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_36 [Tanh] outputs: [694 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_37 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2424 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 694 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_37 [Mul] inputs: [2424 -> (1, 128, 128, 128)], [694 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_37 for ONNX node: Mul_37 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 695 for ONNX tensor: 695 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_37 [Mul] outputs: [695 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_38 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 695 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2428 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2429 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_38 [Conv] inputs: [695 -> (1, 128, 128, 128)], [2428 -> (64, 128, 1, 1)], [2429 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_38 for ONNX node: Conv_38 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2427 for ONNX tensor: 2427 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_38 [Conv] outputs: [2427 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_39 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2427 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_39 [Softplus] inputs: [2427 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_39 for ONNX node: Softplus_39 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 698 for ONNX tensor: 698 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_39 [Softplus] outputs: [698 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_40 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 698 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_40 [Tanh] inputs: [698 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_40 for ONNX node: Tanh_40 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 699 for ONNX tensor: 699 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_40 [Tanh] outputs: [699 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_41 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2427 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 699 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_41 [Mul] inputs: [2427 -> (1, 64, 128, 128)], [699 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_41 for ONNX node: Mul_41 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 700 for ONNX tensor: 700 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_41 [Mul] outputs: [700 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_42 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 695 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2431 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2432 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_42 [Conv] inputs: [695 -> (1, 128, 128, 128)], [2431 -> (64, 128, 1, 1)], [2432 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_42 for ONNX node: Conv_42 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2430 for ONNX tensor: 2430 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_42 [Conv] outputs: [2430 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_43 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2430 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_43 [Softplus] inputs: [2430 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_43 for ONNX node: Softplus_43 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 703 for ONNX tensor: 703 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_43 [Softplus] outputs: [703 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_44 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 703 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_44 [Tanh] inputs: [703 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_44 for ONNX node: Tanh_44 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 704 for ONNX tensor: 704 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_44 [Tanh] outputs: [704 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_45 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2430 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 704 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_45 [Mul] inputs: [2430 -> (1, 64, 128, 128)], [704 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_45 for ONNX node: Mul_45 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 705 for ONNX tensor: 705 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_45 [Mul] outputs: [705 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_46 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 705 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2434 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2435 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_46 [Conv] inputs: [705 -> (1, 64, 128, 128)], [2434 -> (64, 64, 1, 1)], [2435 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_46 for ONNX node: Conv_46 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2433 for ONNX tensor: 2433 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_46 [Conv] outputs: [2433 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_47 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2433 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_47 [Softplus] inputs: [2433 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_47 for ONNX node: Softplus_47 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 708 for ONNX tensor: 708 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_47 [Softplus] outputs: [708 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_48 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 708 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_48 [Tanh] inputs: [708 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_48 for ONNX node: Tanh_48 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 709 for ONNX tensor: 709 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_48 [Tanh] outputs: [709 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_49 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2433 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 709 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_49 [Mul] inputs: [2433 -> (1, 64, 128, 128)], [709 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_49 for ONNX node: Mul_49 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 710 for ONNX tensor: 710 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_49 [Mul] outputs: [710 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_50 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 710 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2437 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2438 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_50 [Conv] inputs: [710 -> (1, 64, 128, 128)], [2437 -> (64, 64, 3, 3)], [2438 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_50 for ONNX node: Conv_50 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2436 for ONNX tensor: 2436 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_50 [Conv] outputs: [2436 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_51 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2436 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_51 [Softplus] inputs: [2436 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_51 for ONNX node: Softplus_51 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 713 for ONNX tensor: 713 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_51 [Softplus] outputs: [713 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_52 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 713 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_52 [Tanh] inputs: [713 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_52 for ONNX node: Tanh_52 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 714 for ONNX tensor: 714 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_52 [Tanh] outputs: [714 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_53 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2436 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 714 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_53 [Mul] inputs: [2436 -> (1, 64, 128, 128)], [714 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_53 for ONNX node: Mul_53 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 715 for ONNX tensor: 715 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_53 [Mul] outputs: [715 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_54 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 705 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 715 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_54 [Add] inputs: [705 -> (1, 64, 128, 128)], [715 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_54 for ONNX node: Add_54 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 716 for ONNX tensor: 716 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_54 [Add] outputs: [716 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_55 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 716 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2440 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2441 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_55 [Conv] inputs: [716 -> (1, 64, 128, 128)], [2440 -> (64, 64, 1, 1)], [2441 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_55 for ONNX node: Conv_55 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2439 for ONNX tensor: 2439 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_55 [Conv] outputs: [2439 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_56 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2439 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_56 [Softplus] inputs: [2439 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_56 for ONNX node: Softplus_56 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 719 for ONNX tensor: 719 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_56 [Softplus] outputs: [719 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_57 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 719 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_57 [Tanh] inputs: [719 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_57 for ONNX node: Tanh_57 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 720 for ONNX tensor: 720 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_57 [Tanh] outputs: [720 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_58 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2439 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 720 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_58 [Mul] inputs: [2439 -> (1, 64, 128, 128)], [720 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_58 for ONNX node: Mul_58 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 721 for ONNX tensor: 721 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_58 [Mul] outputs: [721 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_59 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 721 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2443 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2444 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_59 [Conv] inputs: [721 -> (1, 64, 128, 128)], [2443 -> (64, 64, 3, 3)], [2444 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_59 for ONNX node: Conv_59 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2442 for ONNX tensor: 2442 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_59 [Conv] outputs: [2442 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_60 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2442 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_60 [Softplus] inputs: [2442 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_60 for ONNX node: Softplus_60 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 724 for ONNX tensor: 724 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_60 [Softplus] outputs: [724 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_61 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 724 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_61 [Tanh] inputs: [724 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_61 for ONNX node: Tanh_61 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 725 for ONNX tensor: 725 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_61 [Tanh] outputs: [725 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_62 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2442 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 725 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_62 [Mul] inputs: [2442 -> (1, 64, 128, 128)], [725 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_62 for ONNX node: Mul_62 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 726 for ONNX tensor: 726 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_62 [Mul] outputs: [726 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_63 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 716 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 726 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_63 [Add] inputs: [716 -> (1, 64, 128, 128)], [726 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_63 for ONNX node: Add_63 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 727 for ONNX tensor: 727 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_63 [Add] outputs: [727 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_64 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 727 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2446 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2447 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_64 [Conv] inputs: [727 -> (1, 64, 128, 128)], [2446 -> (64, 64, 1, 1)], [2447 -> (64)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_64 for ONNX node: Conv_64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 64, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2445 for ONNX tensor: 2445 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_64 [Conv] outputs: [2445 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_65 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2445 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_65 [Softplus] inputs: [2445 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_65 for ONNX node: Softplus_65 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 730 for ONNX tensor: 730 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_65 [Softplus] outputs: [730 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_66 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 730 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_66 [Tanh] inputs: [730 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_66 for ONNX node: Tanh_66 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 731 for ONNX tensor: 731 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_66 [Tanh] outputs: [731 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_67 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2445 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 731 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_67 [Mul] inputs: [2445 -> (1, 64, 128, 128)], [731 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_67 for ONNX node: Mul_67 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 732 for ONNX tensor: 732 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_67 [Mul] outputs: [732 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_68 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 732 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 700 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_68 [Concat] inputs: [732 -> (1, 64, 128, 128)], [700 -> (1, 64, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_68 for ONNX node: Concat_68 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 733 for ONNX tensor: 733 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_68 [Concat] outputs: [733 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_69 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 733 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2449 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2450 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_69 [Conv] inputs: [733 -> (1, 128, 128, 128)], [2449 -> (128, 128, 1, 1)], [2450 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_69 for ONNX node: Conv_69 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2448 for ONNX tensor: 2448 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_69 [Conv] outputs: [2448 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_70 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2448 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_70 [Softplus] inputs: [2448 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_70 for ONNX node: Softplus_70 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 736 for ONNX tensor: 736 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_70 [Softplus] outputs: [736 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_71 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 736 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_71 [Tanh] inputs: [736 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_71 for ONNX node: Tanh_71 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 737 for ONNX tensor: 737 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_71 [Tanh] outputs: [737 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_72 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2448 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 737 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_72 [Mul] inputs: [2448 -> (1, 128, 128, 128)], [737 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_72 for ONNX node: Mul_72 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 738 for ONNX tensor: 738 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_72 [Mul] outputs: [738 -> (1, 128, 128, 128)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_73 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 738 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2452 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2453 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_73 [Conv] inputs: [738 -> (1, 128, 128, 128)], [2452 -> (256, 128, 3, 3)], [2453 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 128, 128) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_73 for ONNX node: Conv_73 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2451 for ONNX tensor: 2451 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_73 [Conv] outputs: [2451 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_74 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2451 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_74 [Softplus] inputs: [2451 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_74 for ONNX node: Softplus_74 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 741 for ONNX tensor: 741 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_74 [Softplus] outputs: [741 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_75 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 741 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_75 [Tanh] inputs: [741 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_75 for ONNX node: Tanh_75 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 742 for ONNX tensor: 742 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_75 [Tanh] outputs: [742 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_76 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2451 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 742 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_76 [Mul] inputs: [2451 -> (1, 256, 64, 64)], [742 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_76 for ONNX node: Mul_76 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 743 for ONNX tensor: 743 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_76 [Mul] outputs: [743 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_77 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 743 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2455 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2456 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_77 [Conv] inputs: [743 -> (1, 256, 64, 64)], [2455 -> (128, 256, 1, 1)], [2456 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_77 for ONNX node: Conv_77 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2454 for ONNX tensor: 2454 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_77 [Conv] outputs: [2454 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_78 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2454 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_78 [Softplus] inputs: [2454 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_78 for ONNX node: Softplus_78 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 746 for ONNX tensor: 746 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_78 [Softplus] outputs: [746 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_79 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 746 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_79 [Tanh] inputs: [746 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_79 for ONNX node: Tanh_79 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 747 for ONNX tensor: 747 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_79 [Tanh] outputs: [747 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_80 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2454 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 747 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_80 [Mul] inputs: [2454 -> (1, 128, 64, 64)], [747 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_80 for ONNX node: Mul_80 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 748 for ONNX tensor: 748 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_80 [Mul] outputs: [748 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_81 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 743 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2458 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2459 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_81 [Conv] inputs: [743 -> (1, 256, 64, 64)], [2458 -> (128, 256, 1, 1)], [2459 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_81 for ONNX node: Conv_81 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2457 for ONNX tensor: 2457 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_81 [Conv] outputs: [2457 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_82 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2457 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_82 [Softplus] inputs: [2457 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_82 for ONNX node: Softplus_82 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 751 for ONNX tensor: 751 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_82 [Softplus] outputs: [751 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_83 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 751 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_83 [Tanh] inputs: [751 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_83 for ONNX node: Tanh_83 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 752 for ONNX tensor: 752 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_83 [Tanh] outputs: [752 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_84 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2457 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 752 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_84 [Mul] inputs: [2457 -> (1, 128, 64, 64)], [752 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_84 for ONNX node: Mul_84 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 753 for ONNX tensor: 753 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_84 [Mul] outputs: [753 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_85 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 753 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2461 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2462 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_85 [Conv] inputs: [753 -> (1, 128, 64, 64)], [2461 -> (128, 128, 1, 1)], [2462 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_85 for ONNX node: Conv_85 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2460 for ONNX tensor: 2460 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_85 [Conv] outputs: [2460 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_86 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2460 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_86 [Softplus] inputs: [2460 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_86 for ONNX node: Softplus_86 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 756 for ONNX tensor: 756 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_86 [Softplus] outputs: [756 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_87 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 756 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_87 [Tanh] inputs: [756 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_87 for ONNX node: Tanh_87 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 757 for ONNX tensor: 757 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_87 [Tanh] outputs: [757 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_88 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2460 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 757 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_88 [Mul] inputs: [2460 -> (1, 128, 64, 64)], [757 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_88 for ONNX node: Mul_88 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 758 for ONNX tensor: 758 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_88 [Mul] outputs: [758 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_89 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 758 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2464 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2465 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_89 [Conv] inputs: [758 -> (1, 128, 64, 64)], [2464 -> (128, 128, 3, 3)], [2465 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_89 for ONNX node: Conv_89 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2463 for ONNX tensor: 2463 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_89 [Conv] outputs: [2463 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_90 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2463 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_90 [Softplus] inputs: [2463 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_90 for ONNX node: Softplus_90 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 761 for ONNX tensor: 761 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_90 [Softplus] outputs: [761 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_91 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 761 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_91 [Tanh] inputs: [761 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_91 for ONNX node: Tanh_91 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 762 for ONNX tensor: 762 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_91 [Tanh] outputs: [762 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_92 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2463 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 762 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_92 [Mul] inputs: [2463 -> (1, 128, 64, 64)], [762 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_92 for ONNX node: Mul_92 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 763 for ONNX tensor: 763 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_92 [Mul] outputs: [763 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_93 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 753 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 763 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_93 [Add] inputs: [753 -> (1, 128, 64, 64)], [763 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_93 for ONNX node: Add_93 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 764 for ONNX tensor: 764 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_93 [Add] outputs: [764 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_94 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 764 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2467 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2468 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_94 [Conv] inputs: [764 -> (1, 128, 64, 64)], [2467 -> (128, 128, 1, 1)], [2468 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_94 for ONNX node: Conv_94 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2466 for ONNX tensor: 2466 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_94 [Conv] outputs: [2466 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_95 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2466 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_95 [Softplus] inputs: [2466 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_95 for ONNX node: Softplus_95 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 767 for ONNX tensor: 767 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_95 [Softplus] outputs: [767 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_96 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 767 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_96 [Tanh] inputs: [767 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_96 for ONNX node: Tanh_96 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 768 for ONNX tensor: 768 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_96 [Tanh] outputs: [768 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_97 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2466 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 768 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_97 [Mul] inputs: [2466 -> (1, 128, 64, 64)], [768 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_97 for ONNX node: Mul_97 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 769 for ONNX tensor: 769 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_97 [Mul] outputs: [769 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_98 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 769 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2470 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2471 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_98 [Conv] inputs: [769 -> (1, 128, 64, 64)], [2470 -> (128, 128, 3, 3)], [2471 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_98 for ONNX node: Conv_98 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2469 for ONNX tensor: 2469 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_98 [Conv] outputs: [2469 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_99 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2469 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_99 [Softplus] inputs: [2469 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_99 for ONNX node: Softplus_99 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 772 for ONNX tensor: 772 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_99 [Softplus] outputs: [772 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_100 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 772 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_100 [Tanh] inputs: [772 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_100 for ONNX node: Tanh_100 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 773 for ONNX tensor: 773 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_100 [Tanh] outputs: [773 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_101 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2469 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 773 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_101 [Mul] inputs: [2469 -> (1, 128, 64, 64)], [773 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_101 for ONNX node: Mul_101 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 774 for ONNX tensor: 774 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_101 [Mul] outputs: [774 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_102 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 764 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 774 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_102 [Add] inputs: [764 -> (1, 128, 64, 64)], [774 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_102 for ONNX node: Add_102 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 775 for ONNX tensor: 775 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_102 [Add] outputs: [775 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_103 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 775 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2473 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2474 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_103 [Conv] inputs: [775 -> (1, 128, 64, 64)], [2473 -> (128, 128, 1, 1)], [2474 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_103 for ONNX node: Conv_103 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2472 for ONNX tensor: 2472 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_103 [Conv] outputs: [2472 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_104 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2472 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_104 [Softplus] inputs: [2472 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_104 for ONNX node: Softplus_104 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 778 for ONNX tensor: 778 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_104 [Softplus] outputs: [778 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_105 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 778 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_105 [Tanh] inputs: [778 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_105 for ONNX node: Tanh_105 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 779 for ONNX tensor: 779 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_105 [Tanh] outputs: [779 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_106 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2472 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 779 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_106 [Mul] inputs: [2472 -> (1, 128, 64, 64)], [779 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_106 for ONNX node: Mul_106 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 780 for ONNX tensor: 780 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_106 [Mul] outputs: [780 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_107 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 780 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2476 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2477 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_107 [Conv] inputs: [780 -> (1, 128, 64, 64)], [2476 -> (128, 128, 3, 3)], [2477 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_107 for ONNX node: Conv_107 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2475 for ONNX tensor: 2475 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_107 [Conv] outputs: [2475 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_108 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2475 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_108 [Softplus] inputs: [2475 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_108 for ONNX node: Softplus_108 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 783 for ONNX tensor: 783 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_108 [Softplus] outputs: [783 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_109 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 783 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_109 [Tanh] inputs: [783 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_109 for ONNX node: Tanh_109 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 784 for ONNX tensor: 784 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_109 [Tanh] outputs: [784 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_110 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2475 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 784 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_110 [Mul] inputs: [2475 -> (1, 128, 64, 64)], [784 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_110 for ONNX node: Mul_110 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 785 for ONNX tensor: 785 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_110 [Mul] outputs: [785 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_111 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 775 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 785 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_111 [Add] inputs: [775 -> (1, 128, 64, 64)], [785 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_111 for ONNX node: Add_111 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 786 for ONNX tensor: 786 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_111 [Add] outputs: [786 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_112 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 786 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2479 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2480 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_112 [Conv] inputs: [786 -> (1, 128, 64, 64)], [2479 -> (128, 128, 1, 1)], [2480 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_112 for ONNX node: Conv_112 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2478 for ONNX tensor: 2478 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_112 [Conv] outputs: [2478 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_113 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2478 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_113 [Softplus] inputs: [2478 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_113 for ONNX node: Softplus_113 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 789 for ONNX tensor: 789 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_113 [Softplus] outputs: [789 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_114 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 789 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_114 [Tanh] inputs: [789 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_114 for ONNX node: Tanh_114 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 790 for ONNX tensor: 790 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_114 [Tanh] outputs: [790 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_115 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2478 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 790 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_115 [Mul] inputs: [2478 -> (1, 128, 64, 64)], [790 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_115 for ONNX node: Mul_115 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 791 for ONNX tensor: 791 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_115 [Mul] outputs: [791 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_116 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 791 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2482 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2483 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_116 [Conv] inputs: [791 -> (1, 128, 64, 64)], [2482 -> (128, 128, 3, 3)], [2483 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_116 for ONNX node: Conv_116 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2481 for ONNX tensor: 2481 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_116 [Conv] outputs: [2481 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_117 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2481 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_117 [Softplus] inputs: [2481 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_117 for ONNX node: Softplus_117 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 794 for ONNX tensor: 794 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_117 [Softplus] outputs: [794 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_118 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 794 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_118 [Tanh] inputs: [794 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_118 for ONNX node: Tanh_118 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 795 for ONNX tensor: 795 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_118 [Tanh] outputs: [795 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_119 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2481 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 795 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_119 [Mul] inputs: [2481 -> (1, 128, 64, 64)], [795 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_119 for ONNX node: Mul_119 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 796 for ONNX tensor: 796 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_119 [Mul] outputs: [796 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_120 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 786 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 796 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_120 [Add] inputs: [786 -> (1, 128, 64, 64)], [796 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_120 for ONNX node: Add_120 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 797 for ONNX tensor: 797 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_120 [Add] outputs: [797 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_121 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 797 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2485 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2486 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_121 [Conv] inputs: [797 -> (1, 128, 64, 64)], [2485 -> (128, 128, 1, 1)], [2486 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_121 for ONNX node: Conv_121 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2484 for ONNX tensor: 2484 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_121 [Conv] outputs: [2484 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_122 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2484 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_122 [Softplus] inputs: [2484 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_122 for ONNX node: Softplus_122 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 800 for ONNX tensor: 800 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_122 [Softplus] outputs: [800 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_123 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 800 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_123 [Tanh] inputs: [800 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_123 for ONNX node: Tanh_123 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 801 for ONNX tensor: 801 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_123 [Tanh] outputs: [801 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_124 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2484 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 801 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_124 [Mul] inputs: [2484 -> (1, 128, 64, 64)], [801 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_124 for ONNX node: Mul_124 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 802 for ONNX tensor: 802 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_124 [Mul] outputs: [802 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_125 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 802 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2488 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2489 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_125 [Conv] inputs: [802 -> (1, 128, 64, 64)], [2488 -> (128, 128, 3, 3)], [2489 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_125 for ONNX node: Conv_125 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2487 for ONNX tensor: 2487 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_125 [Conv] outputs: [2487 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_126 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2487 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_126 [Softplus] inputs: [2487 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_126 for ONNX node: Softplus_126 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 805 for ONNX tensor: 805 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_126 [Softplus] outputs: [805 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_127 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 805 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_127 [Tanh] inputs: [805 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_127 for ONNX node: Tanh_127 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 806 for ONNX tensor: 806 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_127 [Tanh] outputs: [806 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_128 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2487 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 806 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_128 [Mul] inputs: [2487 -> (1, 128, 64, 64)], [806 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_128 for ONNX node: Mul_128 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 807 for ONNX tensor: 807 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_128 [Mul] outputs: [807 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_129 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 797 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 807 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_129 [Add] inputs: [797 -> (1, 128, 64, 64)], [807 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_129 for ONNX node: Add_129 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 808 for ONNX tensor: 808 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_129 [Add] outputs: [808 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_130 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 808 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2491 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2492 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_130 [Conv] inputs: [808 -> (1, 128, 64, 64)], [2491 -> (128, 128, 1, 1)], [2492 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_130 for ONNX node: Conv_130 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2490 for ONNX tensor: 2490 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_130 [Conv] outputs: [2490 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_131 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2490 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_131 [Softplus] inputs: [2490 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_131 for ONNX node: Softplus_131 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 811 for ONNX tensor: 811 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_131 [Softplus] outputs: [811 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_132 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 811 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_132 [Tanh] inputs: [811 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_132 for ONNX node: Tanh_132 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 812 for ONNX tensor: 812 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_132 [Tanh] outputs: [812 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_133 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2490 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 812 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_133 [Mul] inputs: [2490 -> (1, 128, 64, 64)], [812 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_133 for ONNX node: Mul_133 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 813 for ONNX tensor: 813 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_133 [Mul] outputs: [813 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_134 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 813 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2494 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2495 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_134 [Conv] inputs: [813 -> (1, 128, 64, 64)], [2494 -> (128, 128, 3, 3)], [2495 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_134 for ONNX node: Conv_134 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2493 for ONNX tensor: 2493 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_134 [Conv] outputs: [2493 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_135 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2493 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_135 [Softplus] inputs: [2493 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_135 for ONNX node: Softplus_135 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 816 for ONNX tensor: 816 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_135 [Softplus] outputs: [816 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_136 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 816 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_136 [Tanh] inputs: [816 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_136 for ONNX node: Tanh_136 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 817 for ONNX tensor: 817 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_136 [Tanh] outputs: [817 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_137 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2493 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 817 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_137 [Mul] inputs: [2493 -> (1, 128, 64, 64)], [817 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_137 for ONNX node: Mul_137 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 818 for ONNX tensor: 818 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_137 [Mul] outputs: [818 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_138 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 808 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 818 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_138 [Add] inputs: [808 -> (1, 128, 64, 64)], [818 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_138 for ONNX node: Add_138 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 819 for ONNX tensor: 819 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_138 [Add] outputs: [819 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_139 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 819 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2497 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2498 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_139 [Conv] inputs: [819 -> (1, 128, 64, 64)], [2497 -> (128, 128, 1, 1)], [2498 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_139 for ONNX node: Conv_139 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2496 for ONNX tensor: 2496 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_139 [Conv] outputs: [2496 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_140 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2496 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_140 [Softplus] inputs: [2496 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_140 for ONNX node: Softplus_140 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 822 for ONNX tensor: 822 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_140 [Softplus] outputs: [822 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_141 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 822 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_141 [Tanh] inputs: [822 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_141 for ONNX node: Tanh_141 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 823 for ONNX tensor: 823 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_141 [Tanh] outputs: [823 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_142 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2496 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 823 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_142 [Mul] inputs: [2496 -> (1, 128, 64, 64)], [823 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_142 for ONNX node: Mul_142 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 824 for ONNX tensor: 824 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_142 [Mul] outputs: [824 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_143 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 824 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2500 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2501 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_143 [Conv] inputs: [824 -> (1, 128, 64, 64)], [2500 -> (128, 128, 3, 3)], [2501 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_143 for ONNX node: Conv_143 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2499 for ONNX tensor: 2499 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_143 [Conv] outputs: [2499 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_144 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2499 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_144 [Softplus] inputs: [2499 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_144 for ONNX node: Softplus_144 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 827 for ONNX tensor: 827 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_144 [Softplus] outputs: [827 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_145 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 827 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_145 [Tanh] inputs: [827 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_145 for ONNX node: Tanh_145 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 828 for ONNX tensor: 828 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_145 [Tanh] outputs: [828 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_146 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2499 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 828 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_146 [Mul] inputs: [2499 -> (1, 128, 64, 64)], [828 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_146 for ONNX node: Mul_146 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 829 for ONNX tensor: 829 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_146 [Mul] outputs: [829 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_147 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 819 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 829 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_147 [Add] inputs: [819 -> (1, 128, 64, 64)], [829 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_147 for ONNX node: Add_147 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 830 for ONNX tensor: 830 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_147 [Add] outputs: [830 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_148 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 830 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2503 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2504 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_148 [Conv] inputs: [830 -> (1, 128, 64, 64)], [2503 -> (128, 128, 1, 1)], [2504 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_148 for ONNX node: Conv_148 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2502 for ONNX tensor: 2502 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_148 [Conv] outputs: [2502 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_149 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2502 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_149 [Softplus] inputs: [2502 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_149 for ONNX node: Softplus_149 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 833 for ONNX tensor: 833 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_149 [Softplus] outputs: [833 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_150 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 833 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_150 [Tanh] inputs: [833 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_150 for ONNX node: Tanh_150 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 834 for ONNX tensor: 834 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_150 [Tanh] outputs: [834 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_151 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2502 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 834 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_151 [Mul] inputs: [2502 -> (1, 128, 64, 64)], [834 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_151 for ONNX node: Mul_151 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 835 for ONNX tensor: 835 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_151 [Mul] outputs: [835 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_152 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 835 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2506 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2507 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_152 [Conv] inputs: [835 -> (1, 128, 64, 64)], [2506 -> (128, 128, 3, 3)], [2507 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_152 for ONNX node: Conv_152 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2505 for ONNX tensor: 2505 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_152 [Conv] outputs: [2505 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_153 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2505 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_153 [Softplus] inputs: [2505 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_153 for ONNX node: Softplus_153 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 838 for ONNX tensor: 838 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_153 [Softplus] outputs: [838 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_154 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 838 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_154 [Tanh] inputs: [838 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_154 for ONNX node: Tanh_154 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 839 for ONNX tensor: 839 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_154 [Tanh] outputs: [839 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_155 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2505 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 839 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_155 [Mul] inputs: [2505 -> (1, 128, 64, 64)], [839 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_155 for ONNX node: Mul_155 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 840 for ONNX tensor: 840 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_155 [Mul] outputs: [840 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_156 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 830 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 840 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_156 [Add] inputs: [830 -> (1, 128, 64, 64)], [840 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_156 for ONNX node: Add_156 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 841 for ONNX tensor: 841 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_156 [Add] outputs: [841 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_157 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 841 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2509 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2510 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_157 [Conv] inputs: [841 -> (1, 128, 64, 64)], [2509 -> (128, 128, 1, 1)], [2510 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_157 for ONNX node: Conv_157 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2508 for ONNX tensor: 2508 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_157 [Conv] outputs: [2508 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_158 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2508 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_158 [Softplus] inputs: [2508 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_158 for ONNX node: Softplus_158 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 844 for ONNX tensor: 844 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_158 [Softplus] outputs: [844 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_159 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 844 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_159 [Tanh] inputs: [844 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_159 for ONNX node: Tanh_159 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 845 for ONNX tensor: 845 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_159 [Tanh] outputs: [845 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_160 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2508 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 845 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_160 [Mul] inputs: [2508 -> (1, 128, 64, 64)], [845 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_160 for ONNX node: Mul_160 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 846 for ONNX tensor: 846 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_160 [Mul] outputs: [846 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_161 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 846 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 748 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_161 [Concat] inputs: [846 -> (1, 128, 64, 64)], [748 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_161 for ONNX node: Concat_161 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 847 for ONNX tensor: 847 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_161 [Concat] outputs: [847 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_162 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 847 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2512 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2513 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_162 [Conv] inputs: [847 -> (1, 256, 64, 64)], [2512 -> (256, 256, 1, 1)], [2513 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_162 for ONNX node: Conv_162 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2511 for ONNX tensor: 2511 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_162 [Conv] outputs: [2511 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_163 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2511 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_163 [Softplus] inputs: [2511 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_163 for ONNX node: Softplus_163 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 850 for ONNX tensor: 850 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_163 [Softplus] outputs: [850 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_164 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 850 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_164 [Tanh] inputs: [850 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_164 for ONNX node: Tanh_164 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 851 for ONNX tensor: 851 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_164 [Tanh] outputs: [851 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_165 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2511 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 851 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_165 [Mul] inputs: [2511 -> (1, 256, 64, 64)], [851 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_165 for ONNX node: Mul_165 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 852 for ONNX tensor: 852 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_165 [Mul] outputs: [852 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_166 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 852 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2515 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2516 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_166 [Conv] inputs: [852 -> (1, 256, 64, 64)], [2515 -> (512, 256, 3, 3)], [2516 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_166 for ONNX node: Conv_166 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2514 for ONNX tensor: 2514 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_166 [Conv] outputs: [2514 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_167 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2514 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_167 [Softplus] inputs: [2514 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_167 for ONNX node: Softplus_167 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 855 for ONNX tensor: 855 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_167 [Softplus] outputs: [855 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_168 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 855 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_168 [Tanh] inputs: [855 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_168 for ONNX node: Tanh_168 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 856 for ONNX tensor: 856 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_168 [Tanh] outputs: [856 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_169 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2514 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 856 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_169 [Mul] inputs: [2514 -> (1, 512, 32, 32)], [856 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_169 for ONNX node: Mul_169 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 857 for ONNX tensor: 857 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_169 [Mul] outputs: [857 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_170 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 857 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2518 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2519 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_170 [Conv] inputs: [857 -> (1, 512, 32, 32)], [2518 -> (256, 512, 1, 1)], [2519 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_170 for ONNX node: Conv_170 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2517 for ONNX tensor: 2517 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_170 [Conv] outputs: [2517 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_171 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2517 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_171 [Softplus] inputs: [2517 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_171 for ONNX node: Softplus_171 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 860 for ONNX tensor: 860 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_171 [Softplus] outputs: [860 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_172 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 860 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_172 [Tanh] inputs: [860 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_172 for ONNX node: Tanh_172 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 861 for ONNX tensor: 861 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_172 [Tanh] outputs: [861 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_173 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2517 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 861 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_173 [Mul] inputs: [2517 -> (1, 256, 32, 32)], [861 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_173 for ONNX node: Mul_173 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 862 for ONNX tensor: 862 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_173 [Mul] outputs: [862 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_174 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 857 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2521 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2522 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_174 [Conv] inputs: [857 -> (1, 512, 32, 32)], [2521 -> (256, 512, 1, 1)], [2522 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_174 for ONNX node: Conv_174 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2520 for ONNX tensor: 2520 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_174 [Conv] outputs: [2520 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_175 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2520 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_175 [Softplus] inputs: [2520 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_175 for ONNX node: Softplus_175 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 865 for ONNX tensor: 865 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_175 [Softplus] outputs: [865 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_176 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 865 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_176 [Tanh] inputs: [865 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_176 for ONNX node: Tanh_176 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 866 for ONNX tensor: 866 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_176 [Tanh] outputs: [866 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_177 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2520 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 866 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_177 [Mul] inputs: [2520 -> (1, 256, 32, 32)], [866 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_177 for ONNX node: Mul_177 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 867 for ONNX tensor: 867 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_177 [Mul] outputs: [867 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_178 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 867 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2524 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2525 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_178 [Conv] inputs: [867 -> (1, 256, 32, 32)], [2524 -> (256, 256, 1, 1)], [2525 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_178 for ONNX node: Conv_178 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2523 for ONNX tensor: 2523 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_178 [Conv] outputs: [2523 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_179 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2523 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_179 [Softplus] inputs: [2523 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_179 for ONNX node: Softplus_179 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 870 for ONNX tensor: 870 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_179 [Softplus] outputs: [870 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_180 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 870 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_180 [Tanh] inputs: [870 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_180 for ONNX node: Tanh_180 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 871 for ONNX tensor: 871 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_180 [Tanh] outputs: [871 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_181 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2523 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 871 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_181 [Mul] inputs: [2523 -> (1, 256, 32, 32)], [871 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_181 for ONNX node: Mul_181 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 872 for ONNX tensor: 872 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_181 [Mul] outputs: [872 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_182 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 872 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2527 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2528 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_182 [Conv] inputs: [872 -> (1, 256, 32, 32)], [2527 -> (256, 256, 3, 3)], [2528 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_182 for ONNX node: Conv_182 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2526 for ONNX tensor: 2526 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_182 [Conv] outputs: [2526 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_183 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2526 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_183 [Softplus] inputs: [2526 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_183 for ONNX node: Softplus_183 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 875 for ONNX tensor: 875 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_183 [Softplus] outputs: [875 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_184 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 875 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_184 [Tanh] inputs: [875 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_184 for ONNX node: Tanh_184 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 876 for ONNX tensor: 876 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_184 [Tanh] outputs: [876 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_185 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2526 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 876 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_185 [Mul] inputs: [2526 -> (1, 256, 32, 32)], [876 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_185 for ONNX node: Mul_185 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 877 for ONNX tensor: 877 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_185 [Mul] outputs: [877 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_186 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 867 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 877 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_186 [Add] inputs: [867 -> (1, 256, 32, 32)], [877 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_186 for ONNX node: Add_186 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 878 for ONNX tensor: 878 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_186 [Add] outputs: [878 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_187 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 878 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2530 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2531 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_187 [Conv] inputs: [878 -> (1, 256, 32, 32)], [2530 -> (256, 256, 1, 1)], [2531 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_187 for ONNX node: Conv_187 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2529 for ONNX tensor: 2529 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_187 [Conv] outputs: [2529 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_188 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2529 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_188 [Softplus] inputs: [2529 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_188 for ONNX node: Softplus_188 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 881 for ONNX tensor: 881 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_188 [Softplus] outputs: [881 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_189 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 881 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_189 [Tanh] inputs: [881 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_189 for ONNX node: Tanh_189 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 882 for ONNX tensor: 882 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_189 [Tanh] outputs: [882 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_190 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2529 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 882 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_190 [Mul] inputs: [2529 -> (1, 256, 32, 32)], [882 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_190 for ONNX node: Mul_190 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 883 for ONNX tensor: 883 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_190 [Mul] outputs: [883 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_191 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 883 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2533 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2534 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_191 [Conv] inputs: [883 -> (1, 256, 32, 32)], [2533 -> (256, 256, 3, 3)], [2534 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_191 for ONNX node: Conv_191 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2532 for ONNX tensor: 2532 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_191 [Conv] outputs: [2532 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_192 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2532 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_192 [Softplus] inputs: [2532 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_192 for ONNX node: Softplus_192 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 886 for ONNX tensor: 886 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_192 [Softplus] outputs: [886 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_193 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 886 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_193 [Tanh] inputs: [886 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_193 for ONNX node: Tanh_193 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 887 for ONNX tensor: 887 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_193 [Tanh] outputs: [887 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_194 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2532 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 887 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_194 [Mul] inputs: [2532 -> (1, 256, 32, 32)], [887 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_194 for ONNX node: Mul_194 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 888 for ONNX tensor: 888 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_194 [Mul] outputs: [888 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_195 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 878 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 888 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_195 [Add] inputs: [878 -> (1, 256, 32, 32)], [888 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_195 for ONNX node: Add_195 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 889 for ONNX tensor: 889 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_195 [Add] outputs: [889 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_196 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 889 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2536 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2537 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_196 [Conv] inputs: [889 -> (1, 256, 32, 32)], [2536 -> (256, 256, 1, 1)], [2537 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_196 for ONNX node: Conv_196 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2535 for ONNX tensor: 2535 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_196 [Conv] outputs: [2535 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_197 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2535 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_197 [Softplus] inputs: [2535 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_197 for ONNX node: Softplus_197 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 892 for ONNX tensor: 892 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_197 [Softplus] outputs: [892 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_198 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 892 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_198 [Tanh] inputs: [892 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_198 for ONNX node: Tanh_198 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 893 for ONNX tensor: 893 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_198 [Tanh] outputs: [893 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_199 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2535 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 893 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_199 [Mul] inputs: [2535 -> (1, 256, 32, 32)], [893 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_199 for ONNX node: Mul_199 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 894 for ONNX tensor: 894 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_199 [Mul] outputs: [894 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_200 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 894 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2539 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2540 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_200 [Conv] inputs: [894 -> (1, 256, 32, 32)], [2539 -> (256, 256, 3, 3)], [2540 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_200 for ONNX node: Conv_200 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2538 for ONNX tensor: 2538 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_200 [Conv] outputs: [2538 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_201 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2538 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_201 [Softplus] inputs: [2538 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_201 for ONNX node: Softplus_201 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 897 for ONNX tensor: 897 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_201 [Softplus] outputs: [897 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_202 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 897 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_202 [Tanh] inputs: [897 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_202 for ONNX node: Tanh_202 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 898 for ONNX tensor: 898 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_202 [Tanh] outputs: [898 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_203 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2538 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 898 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_203 [Mul] inputs: [2538 -> (1, 256, 32, 32)], [898 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_203 for ONNX node: Mul_203 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 899 for ONNX tensor: 899 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_203 [Mul] outputs: [899 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_204 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 889 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 899 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_204 [Add] inputs: [889 -> (1, 256, 32, 32)], [899 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_204 for ONNX node: Add_204 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 900 for ONNX tensor: 900 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_204 [Add] outputs: [900 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_205 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 900 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2542 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2543 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_205 [Conv] inputs: [900 -> (1, 256, 32, 32)], [2542 -> (256, 256, 1, 1)], [2543 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_205 for ONNX node: Conv_205 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2541 for ONNX tensor: 2541 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_205 [Conv] outputs: [2541 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_206 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2541 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_206 [Softplus] inputs: [2541 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_206 for ONNX node: Softplus_206 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 903 for ONNX tensor: 903 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_206 [Softplus] outputs: [903 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_207 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 903 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_207 [Tanh] inputs: [903 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_207 for ONNX node: Tanh_207 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 904 for ONNX tensor: 904 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_207 [Tanh] outputs: [904 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_208 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2541 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 904 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_208 [Mul] inputs: [2541 -> (1, 256, 32, 32)], [904 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_208 for ONNX node: Mul_208 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 905 for ONNX tensor: 905 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_208 [Mul] outputs: [905 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_209 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 905 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2545 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2546 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_209 [Conv] inputs: [905 -> (1, 256, 32, 32)], [2545 -> (256, 256, 3, 3)], [2546 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_209 for ONNX node: Conv_209 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2544 for ONNX tensor: 2544 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_209 [Conv] outputs: [2544 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_210 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2544 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_210 [Softplus] inputs: [2544 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_210 for ONNX node: Softplus_210 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 908 for ONNX tensor: 908 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_210 [Softplus] outputs: [908 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_211 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 908 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_211 [Tanh] inputs: [908 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_211 for ONNX node: Tanh_211 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 909 for ONNX tensor: 909 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_211 [Tanh] outputs: [909 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_212 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2544 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 909 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_212 [Mul] inputs: [2544 -> (1, 256, 32, 32)], [909 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_212 for ONNX node: Mul_212 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 910 for ONNX tensor: 910 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_212 [Mul] outputs: [910 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_213 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 900 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 910 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_213 [Add] inputs: [900 -> (1, 256, 32, 32)], [910 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_213 for ONNX node: Add_213 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 911 for ONNX tensor: 911 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_213 [Add] outputs: [911 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_214 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 911 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2548 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2549 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_214 [Conv] inputs: [911 -> (1, 256, 32, 32)], [2548 -> (256, 256, 1, 1)], [2549 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_214 for ONNX node: Conv_214 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2547 for ONNX tensor: 2547 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_214 [Conv] outputs: [2547 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_215 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2547 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_215 [Softplus] inputs: [2547 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_215 for ONNX node: Softplus_215 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 914 for ONNX tensor: 914 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_215 [Softplus] outputs: [914 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_216 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 914 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_216 [Tanh] inputs: [914 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_216 for ONNX node: Tanh_216 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 915 for ONNX tensor: 915 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_216 [Tanh] outputs: [915 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_217 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2547 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 915 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_217 [Mul] inputs: [2547 -> (1, 256, 32, 32)], [915 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_217 for ONNX node: Mul_217 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 916 for ONNX tensor: 916 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_217 [Mul] outputs: [916 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_218 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 916 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2551 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2552 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_218 [Conv] inputs: [916 -> (1, 256, 32, 32)], [2551 -> (256, 256, 3, 3)], [2552 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_218 for ONNX node: Conv_218 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2550 for ONNX tensor: 2550 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_218 [Conv] outputs: [2550 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_219 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2550 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_219 [Softplus] inputs: [2550 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_219 for ONNX node: Softplus_219 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 919 for ONNX tensor: 919 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_219 [Softplus] outputs: [919 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_220 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 919 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_220 [Tanh] inputs: [919 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_220 for ONNX node: Tanh_220 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 920 for ONNX tensor: 920 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_220 [Tanh] outputs: [920 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_221 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2550 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 920 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_221 [Mul] inputs: [2550 -> (1, 256, 32, 32)], [920 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_221 for ONNX node: Mul_221 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 921 for ONNX tensor: 921 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_221 [Mul] outputs: [921 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_222 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 911 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 921 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_222 [Add] inputs: [911 -> (1, 256, 32, 32)], [921 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_222 for ONNX node: Add_222 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 922 for ONNX tensor: 922 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_222 [Add] outputs: [922 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_223 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 922 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2554 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2555 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_223 [Conv] inputs: [922 -> (1, 256, 32, 32)], [2554 -> (256, 256, 1, 1)], [2555 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_223 for ONNX node: Conv_223 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2553 for ONNX tensor: 2553 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_223 [Conv] outputs: [2553 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_224 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2553 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_224 [Softplus] inputs: [2553 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_224 for ONNX node: Softplus_224 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 925 for ONNX tensor: 925 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_224 [Softplus] outputs: [925 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_225 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 925 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_225 [Tanh] inputs: [925 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_225 for ONNX node: Tanh_225 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 926 for ONNX tensor: 926 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_225 [Tanh] outputs: [926 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_226 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2553 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 926 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_226 [Mul] inputs: [2553 -> (1, 256, 32, 32)], [926 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_226 for ONNX node: Mul_226 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 927 for ONNX tensor: 927 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_226 [Mul] outputs: [927 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_227 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 927 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2557 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2558 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_227 [Conv] inputs: [927 -> (1, 256, 32, 32)], [2557 -> (256, 256, 3, 3)], [2558 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_227 for ONNX node: Conv_227 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2556 for ONNX tensor: 2556 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_227 [Conv] outputs: [2556 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_228 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2556 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_228 [Softplus] inputs: [2556 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_228 for ONNX node: Softplus_228 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 930 for ONNX tensor: 930 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_228 [Softplus] outputs: [930 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_229 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 930 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_229 [Tanh] inputs: [930 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_229 for ONNX node: Tanh_229 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 931 for ONNX tensor: 931 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_229 [Tanh] outputs: [931 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_230 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2556 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 931 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_230 [Mul] inputs: [2556 -> (1, 256, 32, 32)], [931 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_230 for ONNX node: Mul_230 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 932 for ONNX tensor: 932 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_230 [Mul] outputs: [932 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_231 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 922 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 932 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_231 [Add] inputs: [922 -> (1, 256, 32, 32)], [932 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_231 for ONNX node: Add_231 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 933 for ONNX tensor: 933 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_231 [Add] outputs: [933 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_232 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 933 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2560 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2561 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_232 [Conv] inputs: [933 -> (1, 256, 32, 32)], [2560 -> (256, 256, 1, 1)], [2561 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_232 for ONNX node: Conv_232 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2559 for ONNX tensor: 2559 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_232 [Conv] outputs: [2559 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_233 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2559 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_233 [Softplus] inputs: [2559 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_233 for ONNX node: Softplus_233 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 936 for ONNX tensor: 936 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_233 [Softplus] outputs: [936 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_234 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 936 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_234 [Tanh] inputs: [936 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_234 for ONNX node: Tanh_234 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 937 for ONNX tensor: 937 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_234 [Tanh] outputs: [937 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_235 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2559 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 937 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_235 [Mul] inputs: [2559 -> (1, 256, 32, 32)], [937 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_235 for ONNX node: Mul_235 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 938 for ONNX tensor: 938 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_235 [Mul] outputs: [938 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_236 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 938 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2563 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2564 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_236 [Conv] inputs: [938 -> (1, 256, 32, 32)], [2563 -> (256, 256, 3, 3)], [2564 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_236 for ONNX node: Conv_236 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2562 for ONNX tensor: 2562 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_236 [Conv] outputs: [2562 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_237 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2562 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_237 [Softplus] inputs: [2562 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_237 for ONNX node: Softplus_237 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 941 for ONNX tensor: 941 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_237 [Softplus] outputs: [941 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_238 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 941 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_238 [Tanh] inputs: [941 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_238 for ONNX node: Tanh_238 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 942 for ONNX tensor: 942 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_238 [Tanh] outputs: [942 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_239 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2562 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 942 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_239 [Mul] inputs: [2562 -> (1, 256, 32, 32)], [942 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_239 for ONNX node: Mul_239 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 943 for ONNX tensor: 943 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_239 [Mul] outputs: [943 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_240 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 933 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 943 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_240 [Add] inputs: [933 -> (1, 256, 32, 32)], [943 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_240 for ONNX node: Add_240 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 944 for ONNX tensor: 944 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_240 [Add] outputs: [944 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_241 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 944 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2566 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2567 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_241 [Conv] inputs: [944 -> (1, 256, 32, 32)], [2566 -> (256, 256, 1, 1)], [2567 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_241 for ONNX node: Conv_241 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2565 for ONNX tensor: 2565 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_241 [Conv] outputs: [2565 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_242 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2565 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_242 [Softplus] inputs: [2565 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_242 for ONNX node: Softplus_242 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 947 for ONNX tensor: 947 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_242 [Softplus] outputs: [947 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_243 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 947 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_243 [Tanh] inputs: [947 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_243 for ONNX node: Tanh_243 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 948 for ONNX tensor: 948 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_243 [Tanh] outputs: [948 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_244 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2565 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 948 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_244 [Mul] inputs: [2565 -> (1, 256, 32, 32)], [948 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_244 for ONNX node: Mul_244 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 949 for ONNX tensor: 949 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_244 [Mul] outputs: [949 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_245 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 949 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2569 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2570 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_245 [Conv] inputs: [949 -> (1, 256, 32, 32)], [2569 -> (256, 256, 3, 3)], [2570 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_245 for ONNX node: Conv_245 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2568 for ONNX tensor: 2568 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_245 [Conv] outputs: [2568 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_246 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2568 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_246 [Softplus] inputs: [2568 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_246 for ONNX node: Softplus_246 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 952 for ONNX tensor: 952 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_246 [Softplus] outputs: [952 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_247 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 952 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_247 [Tanh] inputs: [952 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_247 for ONNX node: Tanh_247 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 953 for ONNX tensor: 953 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_247 [Tanh] outputs: [953 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_248 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2568 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 953 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_248 [Mul] inputs: [2568 -> (1, 256, 32, 32)], [953 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_248 for ONNX node: Mul_248 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 954 for ONNX tensor: 954 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_248 [Mul] outputs: [954 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_249 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 944 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 954 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_249 [Add] inputs: [944 -> (1, 256, 32, 32)], [954 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_249 for ONNX node: Add_249 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 955 for ONNX tensor: 955 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_249 [Add] outputs: [955 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_250 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 955 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2572 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2573 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_250 [Conv] inputs: [955 -> (1, 256, 32, 32)], [2572 -> (256, 256, 1, 1)], [2573 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_250 for ONNX node: Conv_250 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2571 for ONNX tensor: 2571 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_250 [Conv] outputs: [2571 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_251 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2571 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_251 [Softplus] inputs: [2571 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_251 for ONNX node: Softplus_251 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 958 for ONNX tensor: 958 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_251 [Softplus] outputs: [958 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_252 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 958 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_252 [Tanh] inputs: [958 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_252 for ONNX node: Tanh_252 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 959 for ONNX tensor: 959 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_252 [Tanh] outputs: [959 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_253 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2571 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 959 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_253 [Mul] inputs: [2571 -> (1, 256, 32, 32)], [959 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_253 for ONNX node: Mul_253 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 960 for ONNX tensor: 960 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_253 [Mul] outputs: [960 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_254 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 960 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 862 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_254 [Concat] inputs: [960 -> (1, 256, 32, 32)], [862 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_254 for ONNX node: Concat_254 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 961 for ONNX tensor: 961 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_254 [Concat] outputs: [961 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_255 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 961 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2575 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2576 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_255 [Conv] inputs: [961 -> (1, 512, 32, 32)], [2575 -> (512, 512, 1, 1)], [2576 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_255 for ONNX node: Conv_255 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2574 for ONNX tensor: 2574 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_255 [Conv] outputs: [2574 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_256 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2574 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_256 [Softplus] inputs: [2574 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_256 for ONNX node: Softplus_256 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 964 for ONNX tensor: 964 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_256 [Softplus] outputs: [964 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_257 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 964 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_257 [Tanh] inputs: [964 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_257 for ONNX node: Tanh_257 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 965 for ONNX tensor: 965 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_257 [Tanh] outputs: [965 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_258 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2574 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 965 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_258 [Mul] inputs: [2574 -> (1, 512, 32, 32)], [965 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_258 for ONNX node: Mul_258 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 966 for ONNX tensor: 966 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_258 [Mul] outputs: [966 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_259 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 966 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2578 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2579 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_259 [Conv] inputs: [966 -> (1, 512, 32, 32)], [2578 -> (1024, 512, 3, 3)], [2579 -> (1024)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_259 for ONNX node: Conv_259 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1024 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2577 for ONNX tensor: 2577 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_259 [Conv] outputs: [2577 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_260 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2577 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_260 [Softplus] inputs: [2577 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_260 for ONNX node: Softplus_260 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 969 for ONNX tensor: 969 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_260 [Softplus] outputs: [969 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_261 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 969 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_261 [Tanh] inputs: [969 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_261 for ONNX node: Tanh_261 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 970 for ONNX tensor: 970 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_261 [Tanh] outputs: [970 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_262 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2577 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 970 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_262 [Mul] inputs: [2577 -> (1, 1024, 16, 16)], [970 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_262 for ONNX node: Mul_262 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 971 for ONNX tensor: 971 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_262 [Mul] outputs: [971 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_263 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 971 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2581 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2582 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_263 [Conv] inputs: [971 -> (1, 1024, 16, 16)], [2581 -> (512, 1024, 1, 1)], [2582 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_263 for ONNX node: Conv_263 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2580 for ONNX tensor: 2580 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_263 [Conv] outputs: [2580 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_264 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2580 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_264 [Softplus] inputs: [2580 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_264 for ONNX node: Softplus_264 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 974 for ONNX tensor: 974 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_264 [Softplus] outputs: [974 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_265 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 974 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_265 [Tanh] inputs: [974 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_265 for ONNX node: Tanh_265 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 975 for ONNX tensor: 975 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_265 [Tanh] outputs: [975 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_266 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2580 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 975 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_266 [Mul] inputs: [2580 -> (1, 512, 16, 16)], [975 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_266 for ONNX node: Mul_266 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 976 for ONNX tensor: 976 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_266 [Mul] outputs: [976 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_267 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 971 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2584 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2585 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_267 [Conv] inputs: [971 -> (1, 1024, 16, 16)], [2584 -> (512, 1024, 1, 1)], [2585 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_267 for ONNX node: Conv_267 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2583 for ONNX tensor: 2583 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_267 [Conv] outputs: [2583 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_268 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2583 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_268 [Softplus] inputs: [2583 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_268 for ONNX node: Softplus_268 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 979 for ONNX tensor: 979 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_268 [Softplus] outputs: [979 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_269 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 979 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_269 [Tanh] inputs: [979 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_269 for ONNX node: Tanh_269 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 980 for ONNX tensor: 980 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_269 [Tanh] outputs: [980 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_270 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2583 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 980 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_270 [Mul] inputs: [2583 -> (1, 512, 16, 16)], [980 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_270 for ONNX node: Mul_270 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 981 for ONNX tensor: 981 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_270 [Mul] outputs: [981 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_271 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 981 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2587 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2588 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_271 [Conv] inputs: [981 -> (1, 512, 16, 16)], [2587 -> (512, 512, 1, 1)], [2588 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_271 for ONNX node: Conv_271 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2586 for ONNX tensor: 2586 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_271 [Conv] outputs: [2586 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_272 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2586 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_272 [Softplus] inputs: [2586 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_272 for ONNX node: Softplus_272 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 984 for ONNX tensor: 984 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_272 [Softplus] outputs: [984 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_273 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 984 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_273 [Tanh] inputs: [984 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_273 for ONNX node: Tanh_273 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 985 for ONNX tensor: 985 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_273 [Tanh] outputs: [985 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_274 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2586 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 985 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_274 [Mul] inputs: [2586 -> (1, 512, 16, 16)], [985 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_274 for ONNX node: Mul_274 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 986 for ONNX tensor: 986 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_274 [Mul] outputs: [986 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_275 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 986 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2590 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2591 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_275 [Conv] inputs: [986 -> (1, 512, 16, 16)], [2590 -> (512, 512, 3, 3)], [2591 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_275 for ONNX node: Conv_275 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2589 for ONNX tensor: 2589 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_275 [Conv] outputs: [2589 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_276 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2589 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_276 [Softplus] inputs: [2589 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_276 for ONNX node: Softplus_276 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 989 for ONNX tensor: 989 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_276 [Softplus] outputs: [989 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_277 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 989 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_277 [Tanh] inputs: [989 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_277 for ONNX node: Tanh_277 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 990 for ONNX tensor: 990 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_277 [Tanh] outputs: [990 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_278 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2589 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 990 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_278 [Mul] inputs: [2589 -> (1, 512, 16, 16)], [990 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_278 for ONNX node: Mul_278 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 991 for ONNX tensor: 991 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_278 [Mul] outputs: [991 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_279 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 981 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 991 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_279 [Add] inputs: [981 -> (1, 512, 16, 16)], [991 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_279 for ONNX node: Add_279 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 992 for ONNX tensor: 992 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_279 [Add] outputs: [992 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_280 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 992 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2593 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2594 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_280 [Conv] inputs: [992 -> (1, 512, 16, 16)], [2593 -> (512, 512, 1, 1)], [2594 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_280 for ONNX node: Conv_280 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2592 for ONNX tensor: 2592 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_280 [Conv] outputs: [2592 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_281 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2592 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_281 [Softplus] inputs: [2592 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_281 for ONNX node: Softplus_281 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 995 for ONNX tensor: 995 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_281 [Softplus] outputs: [995 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_282 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 995 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_282 [Tanh] inputs: [995 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_282 for ONNX node: Tanh_282 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 996 for ONNX tensor: 996 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_282 [Tanh] outputs: [996 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_283 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2592 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 996 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_283 [Mul] inputs: [2592 -> (1, 512, 16, 16)], [996 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_283 for ONNX node: Mul_283 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 997 for ONNX tensor: 997 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_283 [Mul] outputs: [997 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_284 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 997 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2596 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2597 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_284 [Conv] inputs: [997 -> (1, 512, 16, 16)], [2596 -> (512, 512, 3, 3)], [2597 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_284 for ONNX node: Conv_284 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2595 for ONNX tensor: 2595 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_284 [Conv] outputs: [2595 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_285 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2595 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_285 [Softplus] inputs: [2595 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_285 for ONNX node: Softplus_285 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1000 for ONNX tensor: 1000 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_285 [Softplus] outputs: [1000 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_286 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1000 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_286 [Tanh] inputs: [1000 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_286 for ONNX node: Tanh_286 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1001 for ONNX tensor: 1001 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_286 [Tanh] outputs: [1001 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_287 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2595 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1001 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_287 [Mul] inputs: [2595 -> (1, 512, 16, 16)], [1001 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_287 for ONNX node: Mul_287 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1002 for ONNX tensor: 1002 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_287 [Mul] outputs: [1002 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_288 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 992 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1002 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_288 [Add] inputs: [992 -> (1, 512, 16, 16)], [1002 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_288 for ONNX node: Add_288 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1003 for ONNX tensor: 1003 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_288 [Add] outputs: [1003 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_289 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1003 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2599 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2600 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_289 [Conv] inputs: [1003 -> (1, 512, 16, 16)], [2599 -> (512, 512, 1, 1)], [2600 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_289 for ONNX node: Conv_289 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2598 for ONNX tensor: 2598 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_289 [Conv] outputs: [2598 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_290 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2598 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_290 [Softplus] inputs: [2598 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_290 for ONNX node: Softplus_290 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1006 for ONNX tensor: 1006 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_290 [Softplus] outputs: [1006 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_291 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1006 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_291 [Tanh] inputs: [1006 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_291 for ONNX node: Tanh_291 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1007 for ONNX tensor: 1007 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_291 [Tanh] outputs: [1007 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_292 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2598 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1007 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_292 [Mul] inputs: [2598 -> (1, 512, 16, 16)], [1007 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_292 for ONNX node: Mul_292 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1008 for ONNX tensor: 1008 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_292 [Mul] outputs: [1008 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_293 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1008 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2602 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2603 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_293 [Conv] inputs: [1008 -> (1, 512, 16, 16)], [2602 -> (512, 512, 3, 3)], [2603 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_293 for ONNX node: Conv_293 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2601 for ONNX tensor: 2601 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_293 [Conv] outputs: [2601 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_294 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2601 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_294 [Softplus] inputs: [2601 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_294 for ONNX node: Softplus_294 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1011 for ONNX tensor: 1011 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_294 [Softplus] outputs: [1011 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_295 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1011 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_295 [Tanh] inputs: [1011 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_295 for ONNX node: Tanh_295 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1012 for ONNX tensor: 1012 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_295 [Tanh] outputs: [1012 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_296 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2601 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1012 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_296 [Mul] inputs: [2601 -> (1, 512, 16, 16)], [1012 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_296 for ONNX node: Mul_296 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1013 for ONNX tensor: 1013 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_296 [Mul] outputs: [1013 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_297 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1003 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1013 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_297 [Add] inputs: [1003 -> (1, 512, 16, 16)], [1013 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_297 for ONNX node: Add_297 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1014 for ONNX tensor: 1014 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_297 [Add] outputs: [1014 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_298 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1014 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2605 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2606 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_298 [Conv] inputs: [1014 -> (1, 512, 16, 16)], [2605 -> (512, 512, 1, 1)], [2606 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_298 for ONNX node: Conv_298 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2604 for ONNX tensor: 2604 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_298 [Conv] outputs: [2604 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_299 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2604 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_299 [Softplus] inputs: [2604 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_299 for ONNX node: Softplus_299 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1017 for ONNX tensor: 1017 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_299 [Softplus] outputs: [1017 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_300 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1017 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_300 [Tanh] inputs: [1017 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_300 for ONNX node: Tanh_300 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1018 for ONNX tensor: 1018 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_300 [Tanh] outputs: [1018 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_301 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2604 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1018 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_301 [Mul] inputs: [2604 -> (1, 512, 16, 16)], [1018 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_301 for ONNX node: Mul_301 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1019 for ONNX tensor: 1019 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_301 [Mul] outputs: [1019 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_302 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1019 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2608 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2609 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_302 [Conv] inputs: [1019 -> (1, 512, 16, 16)], [2608 -> (512, 512, 3, 3)], [2609 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_302 for ONNX node: Conv_302 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2607 for ONNX tensor: 2607 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_302 [Conv] outputs: [2607 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_303 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2607 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_303 [Softplus] inputs: [2607 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_303 for ONNX node: Softplus_303 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1022 for ONNX tensor: 1022 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_303 [Softplus] outputs: [1022 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_304 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1022 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_304 [Tanh] inputs: [1022 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_304 for ONNX node: Tanh_304 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1023 for ONNX tensor: 1023 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_304 [Tanh] outputs: [1023 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_305 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2607 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1023 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_305 [Mul] inputs: [2607 -> (1, 512, 16, 16)], [1023 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_305 for ONNX node: Mul_305 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1024 for ONNX tensor: 1024 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_305 [Mul] outputs: [1024 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_306 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1014 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1024 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_306 [Add] inputs: [1014 -> (1, 512, 16, 16)], [1024 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_306 for ONNX node: Add_306 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1025 for ONNX tensor: 1025 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_306 [Add] outputs: [1025 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_307 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1025 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2611 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2612 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_307 [Conv] inputs: [1025 -> (1, 512, 16, 16)], [2611 -> (512, 512, 1, 1)], [2612 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_307 for ONNX node: Conv_307 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2610 for ONNX tensor: 2610 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_307 [Conv] outputs: [2610 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_308 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2610 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_308 [Softplus] inputs: [2610 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_308 for ONNX node: Softplus_308 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1028 for ONNX tensor: 1028 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_308 [Softplus] outputs: [1028 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_309 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1028 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_309 [Tanh] inputs: [1028 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_309 for ONNX node: Tanh_309 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1029 for ONNX tensor: 1029 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_309 [Tanh] outputs: [1029 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_310 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2610 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1029 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_310 [Mul] inputs: [2610 -> (1, 512, 16, 16)], [1029 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_310 for ONNX node: Mul_310 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1030 for ONNX tensor: 1030 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_310 [Mul] outputs: [1030 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_311 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1030 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 976 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_311 [Concat] inputs: [1030 -> (1, 512, 16, 16)], [976 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_311 for ONNX node: Concat_311 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1031 for ONNX tensor: 1031 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_311 [Concat] outputs: [1031 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_312 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1031 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2614 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2615 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_312 [Conv] inputs: [1031 -> (1, 1024, 16, 16)], [2614 -> (1024, 1024, 1, 1)], [2615 -> (1024)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_312 for ONNX node: Conv_312 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1024 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2613 for ONNX tensor: 2613 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_312 [Conv] outputs: [2613 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softplus_313 [Softplus] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2613 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Softplus_313 [Softplus] inputs: [2613 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softplus_313 for ONNX node: Softplus_313 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1034 for ONNX tensor: 1034 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Softplus_313 [Softplus] outputs: [1034 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Tanh_314 [Tanh] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1034 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Tanh_314 [Tanh] inputs: [1034 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Tanh_314 for ONNX node: Tanh_314 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1035 for ONNX tensor: 1035 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Tanh_314 [Tanh] outputs: [1035 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_315 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2613 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1035 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_315 [Mul] inputs: [2613 -> (1, 1024, 16, 16)], [1035 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_315 for ONNX node: Mul_315 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1036 for ONNX tensor: 1036 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_315 [Mul] outputs: [1036 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_316 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1036 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2617 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2618 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_316 [Conv] inputs: [1036 -> (1, 1024, 16, 16)], [2617 -> (512, 1024, 1, 1)], [2618 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_316 for ONNX node: Conv_316 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2616 for ONNX tensor: 2616 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_316 [Conv] outputs: [2616 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_317 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2616 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_317 [LeakyRelu] inputs: [2616 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_317 for ONNX node: LeakyRelu_317 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1039 for ONNX tensor: 1039 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_317 [LeakyRelu] outputs: [1039 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_318 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1039 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2620 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2621 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_318 [Conv] inputs: [1039 -> (1, 512, 16, 16)], [2620 -> (1024, 512, 3, 3)], [2621 -> (1024)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_318 for ONNX node: Conv_318 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1024 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2619 for ONNX tensor: 2619 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_318 [Conv] outputs: [2619 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_319 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2619 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_319 [LeakyRelu] inputs: [2619 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_319 for ONNX node: LeakyRelu_319 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1042 for ONNX tensor: 1042 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_319 [LeakyRelu] outputs: [1042 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_320 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1042 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2623 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2624 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_320 [Conv] inputs: [1042 -> (1, 1024, 16, 16)], [2623 -> (512, 1024, 1, 1)], [2624 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_320 for ONNX node: Conv_320 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2622 for ONNX tensor: 2622 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_320 [Conv] outputs: [2622 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_321 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2622 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_321 [LeakyRelu] inputs: [2622 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_321 for ONNX node: LeakyRelu_321 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1045 for ONNX tensor: 1045 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_321 [LeakyRelu] outputs: [1045 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: MaxPool_322 [MaxPool] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1045 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: MaxPool_322 [MaxPool] inputs: [1045 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: MaxPool_322 for ONNX node: MaxPool_322 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1046 for ONNX tensor: 1046 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: MaxPool_322 [MaxPool] outputs: [1046 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: MaxPool_323 [MaxPool] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1045 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: MaxPool_323 [MaxPool] inputs: [1045 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: MaxPool_323 for ONNX node: MaxPool_323 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1047 for ONNX tensor: 1047 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: MaxPool_323 [MaxPool] outputs: [1047 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: MaxPool_324 [MaxPool] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1045 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: MaxPool_324 [MaxPool] inputs: [1045 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: MaxPool_324 for ONNX node: MaxPool_324 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1048 for ONNX tensor: 1048 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: MaxPool_324 [MaxPool] outputs: [1048 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_325 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1048 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1047 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1046 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1045 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_325 [Concat] inputs: [1048 -> (1, 512, 16, 16)], [1047 -> (1, 512, 16, 16)], [1046 -> (1, 512, 16, 16)], [1045 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_325 for ONNX node: Concat_325 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1049 for ONNX tensor: 1049 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_325 [Concat] outputs: [1049 -> (1, 2048, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_326 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1049 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2626 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2627 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_326 [Conv] inputs: [1049 -> (1, 2048, 16, 16)], [2626 -> (512, 2048, 1, 1)], [2627 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 2048, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_326 for ONNX node: Conv_326 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2625 for ONNX tensor: 2625 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_326 [Conv] outputs: [2625 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_327 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2625 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_327 [LeakyRelu] inputs: [2625 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_327 for ONNX node: LeakyRelu_327 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1052 for ONNX tensor: 1052 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_327 [LeakyRelu] outputs: [1052 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_328 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1052 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2629 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2630 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_328 [Conv] inputs: [1052 -> (1, 512, 16, 16)], [2629 -> (1024, 512, 3, 3)], [2630 -> (1024)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_328 for ONNX node: Conv_328 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1024 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2628 for ONNX tensor: 2628 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_328 [Conv] outputs: [2628 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_329 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2628 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_329 [LeakyRelu] inputs: [2628 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_329 for ONNX node: LeakyRelu_329 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1055 for ONNX tensor: 1055 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_329 [LeakyRelu] outputs: [1055 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_330 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1055 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2632 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2633 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_330 [Conv] inputs: [1055 -> (1, 1024, 16, 16)], [2632 -> (512, 1024, 1, 1)], [2633 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_330 for ONNX node: Conv_330 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2631 for ONNX tensor: 2631 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_330 [Conv] outputs: [2631 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_331 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2631 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_331 [LeakyRelu] inputs: [2631 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_331 for ONNX node: LeakyRelu_331 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1058 for ONNX tensor: 1058 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_331 [LeakyRelu] outputs: [1058 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_332 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1058 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2635 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2636 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_332 [Conv] inputs: [1058 -> (1, 512, 16, 16)], [2635 -> (256, 512, 1, 1)], [2636 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_332 for ONNX node: Conv_332 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2634 for ONNX tensor: 2634 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_332 [Conv] outputs: [2634 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_333 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2634 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_333 [LeakyRelu] inputs: [2634 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_333 for ONNX node: LeakyRelu_333 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1061 for ONNX tensor: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_333 [LeakyRelu] outputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_334 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_334 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_334 for ONNX node: Shape_334 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1062 for ONNX tensor: 1062 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_334 [Shape] outputs: [1062 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_335 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_335 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_335 [Constant] outputs: [1063 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_336 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1062 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1063 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_336 [Gather] inputs: [1062 -> (4)], [1063 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1063 for ONNX initializer: 1063 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_336 for ONNX node: Gather_336 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1064 for ONNX tensor: 1064 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_336 [Gather] outputs: [1064 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_337 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_337 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_337 for ONNX node: Shape_337 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1065 for ONNX tensor: 1065 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_337 [Shape] outputs: [1065 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_338 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_338 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_338 [Constant] outputs: [1066 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_339 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1065 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1066 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_339 [Gather] inputs: [1065 -> (4)], [1066 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1066 for ONNX initializer: 1066 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_339 for ONNX node: Gather_339 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1067 for ONNX tensor: 1067 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_339 [Gather] outputs: [1067 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_340 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_340 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_340 for ONNX node: Shape_340 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1068 for ONNX tensor: 1068 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_340 [Shape] outputs: [1068 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_341 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_341 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_341 [Constant] outputs: [1069 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_342 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1068 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1069 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_342 [Gather] inputs: [1068 -> (4)], [1069 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1069 for ONNX initializer: 1069 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_342 for ONNX node: Gather_342 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1070 for ONNX tensor: 1070 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_342 [Gather] outputs: [1070 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_343 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_343 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_343 for ONNX node: Shape_343 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1071 for ONNX tensor: 1071 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_343 [Shape] outputs: [1071 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_344 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_344 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_344 [Constant] outputs: [1072 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_345 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1071 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1072 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_345 [Gather] inputs: [1071 -> (4)], [1072 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1072 for ONNX initializer: 1072 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_345 for ONNX node: Gather_345 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1073 for ONNX tensor: 1073 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_345 [Gather] outputs: [1073 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_346 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1064 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_346 [Unsqueeze] inputs: [1064 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_346 for ONNX node: Unsqueeze_346 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1076 for ONNX tensor: 1076 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_346 [Unsqueeze] outputs: [1076 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_347 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1067 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_347 [Unsqueeze] inputs: [1067 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_347 for ONNX node: Unsqueeze_347 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1077 for ONNX tensor: 1077 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_347 [Unsqueeze] outputs: [1077 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_348 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1070 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_348 [Unsqueeze] inputs: [1070 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_348 for ONNX node: Unsqueeze_348 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1078 for ONNX tensor: 1078 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_348 [Unsqueeze] outputs: [1078 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_349 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1073 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_349 [Unsqueeze] inputs: [1073 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_349 for ONNX node: Unsqueeze_349 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1080 for ONNX tensor: 1080 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_349 [Unsqueeze] outputs: [1080 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_350 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1076 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1077 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1078 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2721 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1080 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2722 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_350 [Concat] inputs: [1076 -> (1)], [1077 -> (1)], [1078 -> (1)], [2721 -> (1)], [1080 -> (1)], [2722 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2721 for ONNX initializer: 2721 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2722 for ONNX initializer: 2722 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_350 for ONNX node: Concat_350 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1082 for ONNX tensor: 1082 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_350 [Concat] outputs: [1082 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_351 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1082 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_351 [Reshape] inputs: [1061 -> (1, 256, 16, 16)], [1082 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_351 for ONNX node: Reshape_351 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1083 for ONNX tensor: 1083 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_351 [Reshape] outputs: [1083 -> (-1, -1, -1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_352 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_352 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_352 for ONNX node: Shape_352 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1084 for ONNX tensor: 1084 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_352 [Shape] outputs: [1084 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_353 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_353 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_353 [Constant] outputs: [1085 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_354 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1084 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1085 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_354 [Gather] inputs: [1084 -> (4)], [1085 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1085 for ONNX initializer: 1085 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_354 for ONNX node: Gather_354 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1086 for ONNX tensor: 1086 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_354 [Gather] outputs: [1086 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_355 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_355 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_355 for ONNX node: Shape_355 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1087 for ONNX tensor: 1087 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_355 [Shape] outputs: [1087 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_356 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_356 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_356 [Constant] outputs: [1088 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_357 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1087 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1088 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_357 [Gather] inputs: [1087 -> (4)], [1088 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1088 for ONNX initializer: 1088 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_357 for ONNX node: Gather_357 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1089 for ONNX tensor: 1089 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_357 [Gather] outputs: [1089 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_358 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_358 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_358 for ONNX node: Shape_358 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1090 for ONNX tensor: 1090 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_358 [Shape] outputs: [1090 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_359 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_359 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_359 [Constant] outputs: [1091 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_360 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1090 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1091 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_360 [Gather] inputs: [1090 -> (4)], [1091 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1091 for ONNX initializer: 1091 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_360 for ONNX node: Gather_360 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1092 for ONNX tensor: 1092 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_360 [Gather] outputs: [1092 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_361 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_361 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_361 for ONNX node: Shape_361 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1093 for ONNX tensor: 1093 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_361 [Shape] outputs: [1093 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_362 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_362 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_362 [Constant] outputs: [1094 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_363 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1093 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1094 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_363 [Gather] inputs: [1093 -> (4)], [1094 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1094 for ONNX initializer: 1094 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_363 for ONNX node: Gather_363 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1095 for ONNX tensor: 1095 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_363 [Gather] outputs: [1095 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_364 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1086 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_364 [Unsqueeze] inputs: [1086 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_364 for ONNX node: Unsqueeze_364 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1098 for ONNX tensor: 1098 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_364 [Unsqueeze] outputs: [1098 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_365 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1089 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_365 [Unsqueeze] inputs: [1089 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_365 for ONNX node: Unsqueeze_365 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1099 for ONNX tensor: 1099 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_365 [Unsqueeze] outputs: [1099 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_366 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1092 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_366 [Unsqueeze] inputs: [1092 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_366 for ONNX node: Unsqueeze_366 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1100 for ONNX tensor: 1100 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_366 [Unsqueeze] outputs: [1100 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_367 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1095 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_367 [Unsqueeze] inputs: [1095 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_367 for ONNX node: Unsqueeze_367 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1102 for ONNX tensor: 1102 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_367 [Unsqueeze] outputs: [1102 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_368 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1098 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1099 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1100 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2723 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1102 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2724 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_368 [Concat] inputs: [1098 -> (1)], [1099 -> (1)], [1100 -> (1)], [2723 -> (1)], [1102 -> (1)], [2724 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2723 for ONNX initializer: 2723 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2724 for ONNX initializer: 2724 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_368 for ONNX node: Concat_368 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1104 for ONNX tensor: 1104 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_368 [Concat] outputs: [1104 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_369 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_369 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_369 [Constant] outputs: [1105 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_370 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1104 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1105 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_370 [Reshape] inputs: [1104 -> (6)], [1105 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_370 for ONNX node: Reshape_370 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1106 for ONNX tensor: 1106 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_370 [Reshape] outputs: [1106 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_371 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1106 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_371 [Shape] inputs: [1106 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_371 for ONNX node: Shape_371 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1107 for ONNX tensor: 1107 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_371 [Shape] outputs: [1107 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: ConstantOfShape_372 [ConstantOfShape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1107 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: ConstantOfShape_372 [ConstantOfShape] inputs: [1107 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: ConstantOfShape_372 for ONNX node: ConstantOfShape_372 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1108 for ONNX tensor: 1108 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: ConstantOfShape_372 [ConstantOfShape] outputs: [1108 -> (-1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_373 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_373 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_373 [Constant] outputs: [1109 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_374 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1108 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1109 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_374 [Mul] inputs: [1108 -> (-1)], [1109 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1109 for ONNX initializer: 1109 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_374 for ONNX node: Mul_374 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1110 for ONNX tensor: 1110 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_374 [Mul] outputs: [1110 -> (-1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Equal_375 [Equal] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1106 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1110 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Equal_375 [Equal] inputs: [1106 -> (6)], [1110 -> (-1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Equal_375 for ONNX node: Equal_375 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1111 for ONNX tensor: 1111 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Equal_375 [Equal] outputs: [1111 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Cast_376 [Cast] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1111 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Cast_376 [Cast] inputs: [1111 -> (6)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: bool [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Cast_376 for ONNX node: Cast_376 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1112 for ONNX tensor: 1112 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Cast_376 [Cast] outputs: [1112 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Where_377 [Where] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1112 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1108 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1106 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Where_377 [Where] inputs: [1112 -> (6)], [1108 -> (-1)], [1106 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Where_377 for ONNX node: Where_377 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1113 for ONNX tensor: 1113 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Where_377 [Where] outputs: [1113 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Expand_378 [Expand] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1083 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1113 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Expand_378 [Expand] inputs: [1083 -> (-1, -1, -1, -1, -1, -1)], [1113 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Expand_378 for ONNX node: Expand_378 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1114 for ONNX tensor: 1114 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Expand_378 [Expand] outputs: [1114 -> (-1, -1, -1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_379 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_379 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_379 for ONNX node: Shape_379 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1115 for ONNX tensor: 1115 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_379 [Shape] outputs: [1115 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_380 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_380 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_380 [Constant] outputs: [1116 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_381 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1115 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1116 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_381 [Gather] inputs: [1115 -> (4)], [1116 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1116 for ONNX initializer: 1116 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_381 for ONNX node: Gather_381 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1117 for ONNX tensor: 1117 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_381 [Gather] outputs: [1117 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_382 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_382 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_382 for ONNX node: Shape_382 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1118 for ONNX tensor: 1118 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_382 [Shape] outputs: [1118 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_383 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_383 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_383 [Constant] outputs: [1119 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_384 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1118 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1119 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_384 [Gather] inputs: [1118 -> (4)], [1119 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1119 for ONNX initializer: 1119 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_384 for ONNX node: Gather_384 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1120 for ONNX tensor: 1120 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_384 [Gather] outputs: [1120 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_385 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_385 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_385 for ONNX node: Shape_385 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1121 for ONNX tensor: 1121 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_385 [Shape] outputs: [1121 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_386 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_386 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_386 [Constant] outputs: [1122 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_387 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1121 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1122 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_387 [Gather] inputs: [1121 -> (4)], [1122 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1122 for ONNX initializer: 1122 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_387 for ONNX node: Gather_387 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1123 for ONNX tensor: 1123 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_387 [Gather] outputs: [1123 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_388 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_388 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_388 [Constant] outputs: [1124 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_389 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1123 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1124 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_389 [Mul] inputs: [1123 -> ()], [1124 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1124 for ONNX initializer: 1124 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_389 for ONNX node: Mul_389 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1125 for ONNX tensor: 1125 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_389 [Mul] outputs: [1125 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_390 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_390 [Shape] inputs: [1061 -> (1, 256, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_390 for ONNX node: Shape_390 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1126 for ONNX tensor: 1126 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_390 [Shape] outputs: [1126 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_391 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_391 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_391 [Constant] outputs: [1127 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_392 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1126 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1127 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_392 [Gather] inputs: [1126 -> (4)], [1127 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1127 for ONNX initializer: 1127 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_392 for ONNX node: Gather_392 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1128 for ONNX tensor: 1128 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_392 [Gather] outputs: [1128 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_393 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_393 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_393 [Constant] outputs: [1129 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_394 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1128 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1129 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_394 [Mul] inputs: [1128 -> ()], [1129 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1129 for ONNX initializer: 1129 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_394 for ONNX node: Mul_394 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1130 for ONNX tensor: 1130 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_394 [Mul] outputs: [1130 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_395 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1117 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_395 [Unsqueeze] inputs: [1117 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_395 for ONNX node: Unsqueeze_395 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1131 for ONNX tensor: 1131 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_395 [Unsqueeze] outputs: [1131 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_396 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1120 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_396 [Unsqueeze] inputs: [1120 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_396 for ONNX node: Unsqueeze_396 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1132 for ONNX tensor: 1132 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_396 [Unsqueeze] outputs: [1132 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_397 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1125 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_397 [Unsqueeze] inputs: [1125 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_397 for ONNX node: Unsqueeze_397 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1133 for ONNX tensor: 1133 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_397 [Unsqueeze] outputs: [1133 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_398 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1130 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_398 [Unsqueeze] inputs: [1130 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_398 for ONNX node: Unsqueeze_398 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1134 for ONNX tensor: 1134 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_398 [Unsqueeze] outputs: [1134 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_399 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1131 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1132 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1133 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1134 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_399 [Concat] inputs: [1131 -> (1)], [1132 -> (1)], [1133 -> (1)], [1134 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_399 for ONNX node: Concat_399 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1135 for ONNX tensor: 1135 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_399 [Concat] outputs: [1135 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_400 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1114 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1135 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_400 [Reshape] inputs: [1114 -> (-1, -1, -1, -1, -1, -1)], [1135 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_400 for ONNX node: Reshape_400 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1136 for ONNX tensor: 1136 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_400 [Reshape] outputs: [1136 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_401 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 966 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2638 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2639 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_401 [Conv] inputs: [966 -> (1, 512, 32, 32)], [2638 -> (256, 512, 1, 1)], [2639 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_401 for ONNX node: Conv_401 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2637 for ONNX tensor: 2637 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_401 [Conv] outputs: [2637 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_402 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2637 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_402 [LeakyRelu] inputs: [2637 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_402 for ONNX node: LeakyRelu_402 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1139 for ONNX tensor: 1139 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_402 [LeakyRelu] outputs: [1139 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_403 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1139 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1136 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_403 [Concat] inputs: [1139 -> (1, 256, 32, 32)], [1136 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_403 for ONNX node: Concat_403 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1140 for ONNX tensor: 1140 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_403 [Concat] outputs: [1140 -> (1, -1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_404 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1140 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2641 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2642 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_404 [Conv] inputs: [1140 -> (1, -1, 32, 32)], [2641 -> (256, 512, 1, 1)], [2642 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, -1, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_404 for ONNX node: Conv_404 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2640 for ONNX tensor: 2640 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_404 [Conv] outputs: [2640 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_405 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2640 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_405 [LeakyRelu] inputs: [2640 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_405 for ONNX node: LeakyRelu_405 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1143 for ONNX tensor: 1143 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_405 [LeakyRelu] outputs: [1143 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_406 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1143 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2645 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_406 [Conv] inputs: [1143 -> (1, 256, 32, 32)], [2644 -> (512, 256, 3, 3)], [2645 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_406 for ONNX node: Conv_406 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2643 for ONNX tensor: 2643 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_406 [Conv] outputs: [2643 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_407 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2643 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_407 [LeakyRelu] inputs: [2643 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_407 for ONNX node: LeakyRelu_407 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1146 for ONNX tensor: 1146 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_407 [LeakyRelu] outputs: [1146 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_408 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1146 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2647 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2648 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_408 [Conv] inputs: [1146 -> (1, 512, 32, 32)], [2647 -> (256, 512, 1, 1)], [2648 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_408 for ONNX node: Conv_408 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2646 for ONNX tensor: 2646 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_408 [Conv] outputs: [2646 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_409 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2646 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_409 [LeakyRelu] inputs: [2646 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_409 for ONNX node: LeakyRelu_409 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1149 for ONNX tensor: 1149 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_409 [LeakyRelu] outputs: [1149 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_410 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1149 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2650 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2651 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_410 [Conv] inputs: [1149 -> (1, 256, 32, 32)], [2650 -> (512, 256, 3, 3)], [2651 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_410 for ONNX node: Conv_410 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2649 for ONNX tensor: 2649 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_410 [Conv] outputs: [2649 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_411 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2649 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_411 [LeakyRelu] inputs: [2649 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_411 for ONNX node: LeakyRelu_411 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1152 for ONNX tensor: 1152 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_411 [LeakyRelu] outputs: [1152 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_412 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1152 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2653 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2654 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_412 [Conv] inputs: [1152 -> (1, 512, 32, 32)], [2653 -> (256, 512, 1, 1)], [2654 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_412 for ONNX node: Conv_412 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2652 for ONNX tensor: 2652 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_412 [Conv] outputs: [2652 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_413 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2652 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_413 [LeakyRelu] inputs: [2652 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_413 for ONNX node: LeakyRelu_413 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1155 for ONNX tensor: 1155 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_413 [LeakyRelu] outputs: [1155 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_414 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1155 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2656 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2657 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_414 [Conv] inputs: [1155 -> (1, 256, 32, 32)], [2656 -> (128, 256, 1, 1)], [2657 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_414 for ONNX node: Conv_414 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2655 for ONNX tensor: 2655 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_414 [Conv] outputs: [2655 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_415 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2655 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_415 [LeakyRelu] inputs: [2655 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_415 for ONNX node: LeakyRelu_415 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1158 for ONNX tensor: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_415 [LeakyRelu] outputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_416 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_416 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_416 for ONNX node: Shape_416 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1159 for ONNX tensor: 1159 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_416 [Shape] outputs: [1159 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_417 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_417 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_417 [Constant] outputs: [1160 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_418 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1159 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1160 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_418 [Gather] inputs: [1159 -> (4)], [1160 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1160 for ONNX initializer: 1160 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_418 for ONNX node: Gather_418 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1161 for ONNX tensor: 1161 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_418 [Gather] outputs: [1161 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_419 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_419 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_419 for ONNX node: Shape_419 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1162 for ONNX tensor: 1162 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_419 [Shape] outputs: [1162 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_420 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_420 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_420 [Constant] outputs: [1163 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_421 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1162 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1163 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_421 [Gather] inputs: [1162 -> (4)], [1163 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1163 for ONNX initializer: 1163 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_421 for ONNX node: Gather_421 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1164 for ONNX tensor: 1164 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_421 [Gather] outputs: [1164 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_422 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_422 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_422 for ONNX node: Shape_422 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1165 for ONNX tensor: 1165 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_422 [Shape] outputs: [1165 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_423 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_423 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_423 [Constant] outputs: [1166 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_424 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1165 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1166 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_424 [Gather] inputs: [1165 -> (4)], [1166 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1166 for ONNX initializer: 1166 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_424 for ONNX node: Gather_424 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1167 for ONNX tensor: 1167 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_424 [Gather] outputs: [1167 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_425 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_425 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_425 for ONNX node: Shape_425 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1168 for ONNX tensor: 1168 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_425 [Shape] outputs: [1168 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_426 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_426 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_426 [Constant] outputs: [1169 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_427 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1168 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1169 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_427 [Gather] inputs: [1168 -> (4)], [1169 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1169 for ONNX initializer: 1169 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_427 for ONNX node: Gather_427 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1170 for ONNX tensor: 1170 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_427 [Gather] outputs: [1170 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_428 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1161 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_428 [Unsqueeze] inputs: [1161 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_428 for ONNX node: Unsqueeze_428 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1173 for ONNX tensor: 1173 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_428 [Unsqueeze] outputs: [1173 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_429 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1164 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_429 [Unsqueeze] inputs: [1164 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_429 for ONNX node: Unsqueeze_429 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1174 for ONNX tensor: 1174 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_429 [Unsqueeze] outputs: [1174 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_430 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1167 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_430 [Unsqueeze] inputs: [1167 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_430 for ONNX node: Unsqueeze_430 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1175 for ONNX tensor: 1175 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_430 [Unsqueeze] outputs: [1175 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_431 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1170 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_431 [Unsqueeze] inputs: [1170 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_431 for ONNX node: Unsqueeze_431 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1177 for ONNX tensor: 1177 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_431 [Unsqueeze] outputs: [1177 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_432 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1173 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1174 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1175 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2725 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1177 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2726 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_432 [Concat] inputs: [1173 -> (1)], [1174 -> (1)], [1175 -> (1)], [2725 -> (1)], [1177 -> (1)], [2726 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2725 for ONNX initializer: 2725 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2726 for ONNX initializer: 2726 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_432 for ONNX node: Concat_432 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1179 for ONNX tensor: 1179 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_432 [Concat] outputs: [1179 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_433 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1179 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_433 [Reshape] inputs: [1158 -> (1, 128, 32, 32)], [1179 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_433 for ONNX node: Reshape_433 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1180 for ONNX tensor: 1180 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_433 [Reshape] outputs: [1180 -> (-1, -1, -1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_434 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_434 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_434 for ONNX node: Shape_434 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1181 for ONNX tensor: 1181 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_434 [Shape] outputs: [1181 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_435 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_435 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_435 [Constant] outputs: [1182 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_436 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1181 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1182 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_436 [Gather] inputs: [1181 -> (4)], [1182 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1182 for ONNX initializer: 1182 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_436 for ONNX node: Gather_436 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1183 for ONNX tensor: 1183 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_436 [Gather] outputs: [1183 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_437 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_437 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_437 for ONNX node: Shape_437 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1184 for ONNX tensor: 1184 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_437 [Shape] outputs: [1184 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_438 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_438 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_438 [Constant] outputs: [1185 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_439 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1184 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1185 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_439 [Gather] inputs: [1184 -> (4)], [1185 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1185 for ONNX initializer: 1185 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_439 for ONNX node: Gather_439 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1186 for ONNX tensor: 1186 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_439 [Gather] outputs: [1186 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_440 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_440 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_440 for ONNX node: Shape_440 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1187 for ONNX tensor: 1187 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_440 [Shape] outputs: [1187 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_441 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_441 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_441 [Constant] outputs: [1188 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_442 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1187 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1188 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_442 [Gather] inputs: [1187 -> (4)], [1188 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1188 for ONNX initializer: 1188 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_442 for ONNX node: Gather_442 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1189 for ONNX tensor: 1189 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_442 [Gather] outputs: [1189 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_443 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_443 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_443 for ONNX node: Shape_443 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1190 for ONNX tensor: 1190 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_443 [Shape] outputs: [1190 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_444 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_444 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_444 [Constant] outputs: [1191 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_445 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1190 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1191 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_445 [Gather] inputs: [1190 -> (4)], [1191 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1191 for ONNX initializer: 1191 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_445 for ONNX node: Gather_445 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1192 for ONNX tensor: 1192 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_445 [Gather] outputs: [1192 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_446 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1183 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_446 [Unsqueeze] inputs: [1183 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_446 for ONNX node: Unsqueeze_446 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1195 for ONNX tensor: 1195 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_446 [Unsqueeze] outputs: [1195 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_447 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1186 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_447 [Unsqueeze] inputs: [1186 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_447 for ONNX node: Unsqueeze_447 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1196 for ONNX tensor: 1196 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_447 [Unsqueeze] outputs: [1196 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_448 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1189 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_448 [Unsqueeze] inputs: [1189 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_448 for ONNX node: Unsqueeze_448 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1197 for ONNX tensor: 1197 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_448 [Unsqueeze] outputs: [1197 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_449 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1192 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_449 [Unsqueeze] inputs: [1192 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_449 for ONNX node: Unsqueeze_449 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1199 for ONNX tensor: 1199 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_449 [Unsqueeze] outputs: [1199 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_450 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1195 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1196 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1197 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2727 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1199 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2728 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_450 [Concat] inputs: [1195 -> (1)], [1196 -> (1)], [1197 -> (1)], [2727 -> (1)], [1199 -> (1)], [2728 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2727 for ONNX initializer: 2727 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2728 for ONNX initializer: 2728 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_450 for ONNX node: Concat_450 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1201 for ONNX tensor: 1201 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_450 [Concat] outputs: [1201 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_451 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_451 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_451 [Constant] outputs: [1202 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_452 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1201 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1202 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_452 [Reshape] inputs: [1201 -> (6)], [1202 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_452 for ONNX node: Reshape_452 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1203 for ONNX tensor: 1203 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_452 [Reshape] outputs: [1203 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_453 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1203 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_453 [Shape] inputs: [1203 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_453 for ONNX node: Shape_453 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1204 for ONNX tensor: 1204 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_453 [Shape] outputs: [1204 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: ConstantOfShape_454 [ConstantOfShape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1204 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: ConstantOfShape_454 [ConstantOfShape] inputs: [1204 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: ConstantOfShape_454 for ONNX node: ConstantOfShape_454 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1205 for ONNX tensor: 1205 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: ConstantOfShape_454 [ConstantOfShape] outputs: [1205 -> (-1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_455 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_455 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_455 [Constant] outputs: [1206 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_456 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1205 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1206 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_456 [Mul] inputs: [1205 -> (-1)], [1206 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1206 for ONNX initializer: 1206 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_456 for ONNX node: Mul_456 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1207 for ONNX tensor: 1207 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_456 [Mul] outputs: [1207 -> (-1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Equal_457 [Equal] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1203 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1207 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Equal_457 [Equal] inputs: [1203 -> (6)], [1207 -> (-1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Equal_457 for ONNX node: Equal_457 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1208 for ONNX tensor: 1208 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Equal_457 [Equal] outputs: [1208 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Cast_458 [Cast] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1208 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Cast_458 [Cast] inputs: [1208 -> (6)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: bool [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Cast_458 for ONNX node: Cast_458 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1209 for ONNX tensor: 1209 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Cast_458 [Cast] outputs: [1209 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Where_459 [Where] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1209 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1205 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1203 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Where_459 [Where] inputs: [1209 -> (6)], [1205 -> (-1)], [1203 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Where_459 for ONNX node: Where_459 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1210 for ONNX tensor: 1210 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Where_459 [Where] outputs: [1210 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Expand_460 [Expand] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1180 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1210 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Expand_460 [Expand] inputs: [1180 -> (-1, -1, -1, -1, -1, -1)], [1210 -> (6)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Expand_460 for ONNX node: Expand_460 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1211 for ONNX tensor: 1211 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Expand_460 [Expand] outputs: [1211 -> (-1, -1, -1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_461 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_461 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_461 for ONNX node: Shape_461 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1212 for ONNX tensor: 1212 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_461 [Shape] outputs: [1212 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_462 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_462 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_462 [Constant] outputs: [1213 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_463 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1212 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1213 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_463 [Gather] inputs: [1212 -> (4)], [1213 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1213 for ONNX initializer: 1213 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_463 for ONNX node: Gather_463 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1214 for ONNX tensor: 1214 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_463 [Gather] outputs: [1214 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_464 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_464 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_464 for ONNX node: Shape_464 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1215 for ONNX tensor: 1215 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_464 [Shape] outputs: [1215 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_465 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_465 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_465 [Constant] outputs: [1216 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_466 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1215 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1216 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_466 [Gather] inputs: [1215 -> (4)], [1216 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1216 for ONNX initializer: 1216 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_466 for ONNX node: Gather_466 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1217 for ONNX tensor: 1217 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_466 [Gather] outputs: [1217 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_467 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_467 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_467 for ONNX node: Shape_467 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1218 for ONNX tensor: 1218 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_467 [Shape] outputs: [1218 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_468 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_468 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_468 [Constant] outputs: [1219 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_469 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1218 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1219 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_469 [Gather] inputs: [1218 -> (4)], [1219 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1219 for ONNX initializer: 1219 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_469 for ONNX node: Gather_469 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1220 for ONNX tensor: 1220 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_469 [Gather] outputs: [1220 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_470 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_470 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_470 [Constant] outputs: [1221 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_471 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1220 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1221 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_471 [Mul] inputs: [1220 -> ()], [1221 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1221 for ONNX initializer: 1221 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_471 for ONNX node: Mul_471 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1222 for ONNX tensor: 1222 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_471 [Mul] outputs: [1222 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_472 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_472 [Shape] inputs: [1158 -> (1, 128, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_472 for ONNX node: Shape_472 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1223 for ONNX tensor: 1223 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_472 [Shape] outputs: [1223 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_473 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_473 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_473 [Constant] outputs: [1224 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_474 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1223 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1224 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_474 [Gather] inputs: [1223 -> (4)], [1224 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1224 for ONNX initializer: 1224 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_474 for ONNX node: Gather_474 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1225 for ONNX tensor: 1225 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_474 [Gather] outputs: [1225 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_475 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_475 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_475 [Constant] outputs: [1226 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_476 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1225 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1226 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_476 [Mul] inputs: [1225 -> ()], [1226 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1226 for ONNX initializer: 1226 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_476 for ONNX node: Mul_476 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1227 for ONNX tensor: 1227 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_476 [Mul] outputs: [1227 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_477 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1214 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_477 [Unsqueeze] inputs: [1214 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_477 for ONNX node: Unsqueeze_477 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1228 for ONNX tensor: 1228 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_477 [Unsqueeze] outputs: [1228 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_478 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1217 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_478 [Unsqueeze] inputs: [1217 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_478 for ONNX node: Unsqueeze_478 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1229 for ONNX tensor: 1229 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_478 [Unsqueeze] outputs: [1229 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_479 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1222 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_479 [Unsqueeze] inputs: [1222 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_479 for ONNX node: Unsqueeze_479 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1230 for ONNX tensor: 1230 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_479 [Unsqueeze] outputs: [1230 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_480 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1227 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_480 [Unsqueeze] inputs: [1227 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_480 for ONNX node: Unsqueeze_480 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1231 for ONNX tensor: 1231 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_480 [Unsqueeze] outputs: [1231 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_481 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1228 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1229 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1230 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1231 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_481 [Concat] inputs: [1228 -> (1)], [1229 -> (1)], [1230 -> (1)], [1231 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_481 for ONNX node: Concat_481 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1232 for ONNX tensor: 1232 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_481 [Concat] outputs: [1232 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_482 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1211 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1232 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_482 [Reshape] inputs: [1211 -> (-1, -1, -1, -1, -1, -1)], [1232 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_482 for ONNX node: Reshape_482 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1233 for ONNX tensor: 1233 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_482 [Reshape] outputs: [1233 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_483 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 852 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2659 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2660 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_483 [Conv] inputs: [852 -> (1, 256, 64, 64)], [2659 -> (128, 256, 1, 1)], [2660 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_483 for ONNX node: Conv_483 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2658 for ONNX tensor: 2658 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_483 [Conv] outputs: [2658 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_484 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2658 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_484 [LeakyRelu] inputs: [2658 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_484 for ONNX node: LeakyRelu_484 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1236 for ONNX tensor: 1236 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_484 [LeakyRelu] outputs: [1236 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_485 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1236 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1233 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_485 [Concat] inputs: [1236 -> (1, 128, 64, 64)], [1233 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_485 for ONNX node: Concat_485 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1237 for ONNX tensor: 1237 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_485 [Concat] outputs: [1237 -> (1, -1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_486 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1237 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2662 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2663 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_486 [Conv] inputs: [1237 -> (1, -1, 64, 64)], [2662 -> (128, 256, 1, 1)], [2663 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, -1, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_486 for ONNX node: Conv_486 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2661 for ONNX tensor: 2661 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_486 [Conv] outputs: [2661 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_487 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2661 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_487 [LeakyRelu] inputs: [2661 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_487 for ONNX node: LeakyRelu_487 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1240 for ONNX tensor: 1240 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_487 [LeakyRelu] outputs: [1240 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_488 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1240 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2665 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2666 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_488 [Conv] inputs: [1240 -> (1, 128, 64, 64)], [2665 -> (256, 128, 3, 3)], [2666 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_488 for ONNX node: Conv_488 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2664 for ONNX tensor: 2664 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_488 [Conv] outputs: [2664 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_489 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2664 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_489 [LeakyRelu] inputs: [2664 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_489 for ONNX node: LeakyRelu_489 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1243 for ONNX tensor: 1243 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_489 [LeakyRelu] outputs: [1243 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_490 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1243 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2668 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2669 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_490 [Conv] inputs: [1243 -> (1, 256, 64, 64)], [2668 -> (128, 256, 1, 1)], [2669 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_490 for ONNX node: Conv_490 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2667 for ONNX tensor: 2667 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_490 [Conv] outputs: [2667 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_491 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2667 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_491 [LeakyRelu] inputs: [2667 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_491 for ONNX node: LeakyRelu_491 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1246 for ONNX tensor: 1246 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_491 [LeakyRelu] outputs: [1246 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_492 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1246 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2671 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2672 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_492 [Conv] inputs: [1246 -> (1, 128, 64, 64)], [2671 -> (256, 128, 3, 3)], [2672 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_492 for ONNX node: Conv_492 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2670 for ONNX tensor: 2670 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_492 [Conv] outputs: [2670 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_493 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2670 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_493 [LeakyRelu] inputs: [2670 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_493 for ONNX node: LeakyRelu_493 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1249 for ONNX tensor: 1249 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_493 [LeakyRelu] outputs: [1249 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_494 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1249 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2674 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2675 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_494 [Conv] inputs: [1249 -> (1, 256, 64, 64)], [2674 -> (128, 256, 1, 1)], [2675 -> (128)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_494 for ONNX node: Conv_494 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2673 for ONNX tensor: 2673 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_494 [Conv] outputs: [2673 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_495 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2673 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_495 [LeakyRelu] inputs: [2673 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_495 for ONNX node: LeakyRelu_495 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1252 for ONNX tensor: 1252 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_495 [LeakyRelu] outputs: [1252 -> (1, 128, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_496 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1252 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2677 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2678 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_496 [Conv] inputs: [1252 -> (1, 128, 64, 64)], [2677 -> (256, 128, 3, 3)], [2678 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_496 for ONNX node: Conv_496 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2676 for ONNX tensor: 2676 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_496 [Conv] outputs: [2676 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_497 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2676 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_497 [LeakyRelu] inputs: [2676 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_497 for ONNX node: LeakyRelu_497 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1255 for ONNX tensor: 1255 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_497 [LeakyRelu] outputs: [1255 -> (1, 256, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_498 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1255 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: models.138.conv94.weight [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: models.138.conv94.bias [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_498 [Conv] inputs: [1255 -> (1, 256, 64, 64)], [models.138.conv94.weight -> (255, 256, 1, 1)], [models.138.conv94.bias -> (255)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_498 for ONNX node: Conv_498 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 255 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 255, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1256 for ONNX tensor: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_498 [Conv] outputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_499 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_499 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_499 [Constant] outputs: [1257 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_500 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_500 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_500 [Constant] outputs: [1258 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_501 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_501 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_501 [Constant] outputs: [1259 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_502 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_502 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_502 [Constant] outputs: [1260 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_503 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1258 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1259 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1257 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1260 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_503 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1258 -> (1)], [1259 -> (1)], [1257 -> (1)], [1260 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_503 for ONNX node: Slice_503 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1261 for ONNX tensor: 1261 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_503 [Slice] outputs: [1261 -> (1, 2, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_504 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_504 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_504 [Constant] outputs: [1262 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_505 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_505 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_505 [Constant] outputs: [1263 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_506 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_506 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_506 [Constant] outputs: [1264 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_507 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_507 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_507 [Constant] outputs: [1265 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_508 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1263 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1264 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1262 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1265 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_508 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1263 -> (1)], [1264 -> (1)], [1262 -> (1)], [1265 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_508 for ONNX node: Slice_508 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1266 for ONNX tensor: 1266 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_508 [Slice] outputs: [1266 -> (1, 2, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_509 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_509 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_509 [Constant] outputs: [1267 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_510 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_510 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_510 [Constant] outputs: [1268 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_511 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_511 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_511 [Constant] outputs: [1269 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_512 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_512 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_512 [Constant] outputs: [1270 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_513 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1268 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1269 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1267 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1270 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_513 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1268 -> (1)], [1269 -> (1)], [1267 -> (1)], [1270 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_513 for ONNX node: Slice_513 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1271 for ONNX tensor: 1271 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_513 [Slice] outputs: [1271 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_514 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_514 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_514 [Constant] outputs: [1272 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_515 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_515 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_515 [Constant] outputs: [1273 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_516 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_516 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_516 [Constant] outputs: [1274 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_517 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_517 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_517 [Constant] outputs: [1275 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_518 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1273 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1274 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1272 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1275 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_518 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1273 -> (1)], [1274 -> (1)], [1272 -> (1)], [1275 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_518 for ONNX node: Slice_518 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1276 for ONNX tensor: 1276 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_518 [Slice] outputs: [1276 -> (1, 80, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_519 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_519 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_519 [Constant] outputs: [1277 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_520 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_520 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_520 [Constant] outputs: [1278 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_521 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_521 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_521 [Constant] outputs: [1279 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_522 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_522 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_522 [Constant] outputs: [1280 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_523 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1278 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1279 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1277 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1280 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_523 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1278 -> (1)], [1279 -> (1)], [1277 -> (1)], [1280 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_523 for ONNX node: Slice_523 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1281 for ONNX tensor: 1281 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_523 [Slice] outputs: [1281 -> (1, 2, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_524 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_524 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_524 [Constant] outputs: [1282 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_525 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_525 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_525 [Constant] outputs: [1283 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_526 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_526 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_526 [Constant] outputs: [1284 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_527 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_527 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_527 [Constant] outputs: [1285 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_528 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1283 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1284 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1282 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1285 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_528 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1283 -> (1)], [1284 -> (1)], [1282 -> (1)], [1285 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_528 for ONNX node: Slice_528 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1286 for ONNX tensor: 1286 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_528 [Slice] outputs: [1286 -> (1, 2, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_529 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_529 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_529 [Constant] outputs: [1287 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_530 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_530 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_530 [Constant] outputs: [1288 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_531 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_531 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_531 [Constant] outputs: [1289 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_532 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_532 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_532 [Constant] outputs: [1290 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_533 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1288 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1289 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1287 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1290 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_533 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1288 -> (1)], [1289 -> (1)], [1287 -> (1)], [1290 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_533 for ONNX node: Slice_533 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1291 for ONNX tensor: 1291 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_533 [Slice] outputs: [1291 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_534 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_534 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_534 [Constant] outputs: [1292 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_535 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_535 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_535 [Constant] outputs: [1293 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_536 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_536 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_536 [Constant] outputs: [1294 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_537 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_537 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_537 [Constant] outputs: [1295 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_538 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1293 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1294 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1292 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1295 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_538 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1293 -> (1)], [1294 -> (1)], [1292 -> (1)], [1295 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_538 for ONNX node: Slice_538 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1296 for ONNX tensor: 1296 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_538 [Slice] outputs: [1296 -> (1, 80, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_539 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_539 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_539 [Constant] outputs: [1297 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_540 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_540 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_540 [Constant] outputs: [1298 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_541 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_541 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_541 [Constant] outputs: [1299 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_542 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_542 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_542 [Constant] outputs: [1300 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_543 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1298 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1299 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1297 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1300 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_543 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1298 -> (1)], [1299 -> (1)], [1297 -> (1)], [1300 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_543 for ONNX node: Slice_543 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1301 for ONNX tensor: 1301 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_543 [Slice] outputs: [1301 -> (1, 2, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_544 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_544 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_544 [Constant] outputs: [1302 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_545 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_545 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_545 [Constant] outputs: [1303 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_546 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_546 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_546 [Constant] outputs: [1304 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_547 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_547 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_547 [Constant] outputs: [1305 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_548 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1303 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1304 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1302 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1305 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_548 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1303 -> (1)], [1304 -> (1)], [1302 -> (1)], [1305 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_548 for ONNX node: Slice_548 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1306 for ONNX tensor: 1306 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_548 [Slice] outputs: [1306 -> (1, 2, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_549 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_549 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_549 [Constant] outputs: [1307 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_550 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_550 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_550 [Constant] outputs: [1308 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_551 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_551 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_551 [Constant] outputs: [1309 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_552 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_552 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_552 [Constant] outputs: [1310 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_553 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1308 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1309 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1307 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1310 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_553 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1308 -> (1)], [1309 -> (1)], [1307 -> (1)], [1310 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_553 for ONNX node: Slice_553 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1311 for ONNX tensor: 1311 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_553 [Slice] outputs: [1311 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_554 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_554 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_554 [Constant] outputs: [1312 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_555 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_555 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_555 [Constant] outputs: [1313 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_556 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_556 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_556 [Constant] outputs: [1314 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_557 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_557 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_557 [Constant] outputs: [1315 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_558 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1313 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1314 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1312 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1315 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_558 [Slice] inputs: [1256 -> (1, 255, 64, 64)], [1313 -> (1)], [1314 -> (1)], [1312 -> (1)], [1315 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_558 for ONNX node: Slice_558 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1316 for ONNX tensor: 1316 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_558 [Slice] outputs: [1316 -> (1, 80, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_559 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1261 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1281 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1301 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_559 [Concat] inputs: [1261 -> (1, 2, 64, 64)], [1281 -> (1, 2, 64, 64)], [1301 -> (1, 2, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_559 for ONNX node: Concat_559 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1317 for ONNX tensor: 1317 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_559 [Concat] outputs: [1317 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_560 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1266 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1286 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1306 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_560 [Concat] inputs: [1266 -> (1, 2, 64, 64)], [1286 -> (1, 2, 64, 64)], [1306 -> (1, 2, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_560 for ONNX node: Concat_560 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1318 for ONNX tensor: 1318 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_560 [Concat] outputs: [1318 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_561 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1271 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1291 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1311 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_561 [Concat] inputs: [1271 -> (1, 1, 64, 64)], [1291 -> (1, 1, 64, 64)], [1311 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_561 for ONNX node: Concat_561 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1319 for ONNX tensor: 1319 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_561 [Concat] outputs: [1319 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_562 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_562 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_562 for ONNX node: Shape_562 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1320 for ONNX tensor: 1320 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_562 [Shape] outputs: [1320 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_563 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_563 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_563 [Constant] outputs: [1321 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_564 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1320 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1321 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_564 [Gather] inputs: [1320 -> (4)], [1321 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1321 for ONNX initializer: 1321 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_564 for ONNX node: Gather_564 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1322 for ONNX tensor: 1322 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_564 [Gather] outputs: [1322 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_565 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_565 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_565 for ONNX node: Shape_565 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1323 for ONNX tensor: 1323 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_565 [Shape] outputs: [1323 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_566 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_566 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_566 [Constant] outputs: [1324 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_567 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1323 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1324 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_567 [Gather] inputs: [1323 -> (4)], [1324 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1324 for ONNX initializer: 1324 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_567 for ONNX node: Gather_567 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1325 for ONNX tensor: 1325 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_567 [Gather] outputs: [1325 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_568 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_568 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_568 [Constant] outputs: [1326 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_569 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1325 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1326 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_569 [Mul] inputs: [1325 -> ()], [1326 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1326 for ONNX initializer: 1326 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_569 for ONNX node: Mul_569 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1327 for ONNX tensor: 1327 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_569 [Mul] outputs: [1327 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_570 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_570 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_570 for ONNX node: Shape_570 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1328 for ONNX tensor: 1328 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_570 [Shape] outputs: [1328 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_571 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_571 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_571 [Constant] outputs: [1329 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_572 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1328 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1329 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_572 [Gather] inputs: [1328 -> (4)], [1329 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1329 for ONNX initializer: 1329 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_572 for ONNX node: Gather_572 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1330 for ONNX tensor: 1330 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_572 [Gather] outputs: [1330 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_573 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1327 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1330 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_573 [Mul] inputs: [1327 -> ()], [1330 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_573 for ONNX node: Mul_573 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1331 for ONNX tensor: 1331 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_573 [Mul] outputs: [1331 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_574 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1322 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_574 [Unsqueeze] inputs: [1322 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_574 for ONNX node: Unsqueeze_574 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1332 for ONNX tensor: 1332 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_574 [Unsqueeze] outputs: [1332 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_575 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1331 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_575 [Unsqueeze] inputs: [1331 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_575 for ONNX node: Unsqueeze_575 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1333 for ONNX tensor: 1333 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_575 [Unsqueeze] outputs: [1333 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_576 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1332 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1333 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_576 [Concat] inputs: [1332 -> (1)], [1333 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_576 for ONNX node: Concat_576 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1334 for ONNX tensor: 1334 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_576 [Concat] outputs: [1334 -> (2)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_577 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1319 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1334 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_577 [Reshape] inputs: [1319 -> (1, 3, 64, 64)], [1334 -> (2)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_577 for ONNX node: Reshape_577 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1335 for ONNX tensor: 1335 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_577 [Reshape] outputs: [1335 -> (-1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_578 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1276 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1296 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1316 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_578 [Concat] inputs: [1276 -> (1, 80, 64, 64)], [1296 -> (1, 80, 64, 64)], [1316 -> (1, 80, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_578 for ONNX node: Concat_578 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1336 for ONNX tensor: 1336 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_578 [Concat] outputs: [1336 -> (1, 240, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_579 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_579 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_579 for ONNX node: Shape_579 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1337 for ONNX tensor: 1337 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_579 [Shape] outputs: [1337 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_580 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_580 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_580 [Constant] outputs: [1338 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_581 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1337 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1338 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_581 [Gather] inputs: [1337 -> (4)], [1338 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1338 for ONNX initializer: 1338 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_581 for ONNX node: Gather_581 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1339 for ONNX tensor: 1339 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_581 [Gather] outputs: [1339 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_582 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_582 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_582 for ONNX node: Shape_582 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1340 for ONNX tensor: 1340 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_582 [Shape] outputs: [1340 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_583 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_583 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_583 [Constant] outputs: [1341 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_584 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1340 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1341 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_584 [Gather] inputs: [1340 -> (4)], [1341 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1341 for ONNX initializer: 1341 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_584 for ONNX node: Gather_584 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1342 for ONNX tensor: 1342 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_584 [Gather] outputs: [1342 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_585 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_585 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_585 for ONNX node: Shape_585 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1343 for ONNX tensor: 1343 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_585 [Shape] outputs: [1343 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_586 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_586 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_586 [Constant] outputs: [1344 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_587 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1343 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1344 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_587 [Gather] inputs: [1343 -> (4)], [1344 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1344 for ONNX initializer: 1344 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_587 for ONNX node: Gather_587 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1345 for ONNX tensor: 1345 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_587 [Gather] outputs: [1345 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_588 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1342 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1345 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_588 [Mul] inputs: [1342 -> ()], [1345 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_588 for ONNX node: Mul_588 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1346 for ONNX tensor: 1346 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_588 [Mul] outputs: [1346 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_589 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1339 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_589 [Unsqueeze] inputs: [1339 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_589 for ONNX node: Unsqueeze_589 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1349 for ONNX tensor: 1349 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_589 [Unsqueeze] outputs: [1349 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_590 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1346 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_590 [Unsqueeze] inputs: [1346 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_590 for ONNX node: Unsqueeze_590 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1352 for ONNX tensor: 1352 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_590 [Unsqueeze] outputs: [1352 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_591 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1349 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2729 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2730 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1352 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_591 [Concat] inputs: [1349 -> (1)], [2729 -> (1)], [2730 -> (1)], [1352 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2729 for ONNX initializer: 2729 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2730 for ONNX initializer: 2730 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_591 for ONNX node: Concat_591 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1353 for ONNX tensor: 1353 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_591 [Concat] outputs: [1353 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_592 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1336 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1353 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_592 [Reshape] inputs: [1336 -> (1, 240, 64, 64)], [1353 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_592 for ONNX node: Reshape_592 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1354 for ONNX tensor: 1354 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_592 [Reshape] outputs: [1354 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_593 [Transpose] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1354 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Transpose_593 [Transpose] inputs: [1354 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_593 for ONNX node: Transpose_593 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1355 for ONNX tensor: 1355 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Transpose_593 [Transpose] outputs: [1355 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_594 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_594 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_594 for ONNX node: Shape_594 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1356 for ONNX tensor: 1356 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_594 [Shape] outputs: [1356 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_595 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_595 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_595 [Constant] outputs: [1357 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_596 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1356 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1357 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_596 [Gather] inputs: [1356 -> (4)], [1357 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1357 for ONNX initializer: 1357 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_596 for ONNX node: Gather_596 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1358 for ONNX tensor: 1358 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_596 [Gather] outputs: [1358 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_597 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_597 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_597 for ONNX node: Shape_597 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1359 for ONNX tensor: 1359 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_597 [Shape] outputs: [1359 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_598 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_598 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_598 [Constant] outputs: [1360 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_599 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1359 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1360 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_599 [Gather] inputs: [1359 -> (4)], [1360 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1360 for ONNX initializer: 1360 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_599 for ONNX node: Gather_599 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1361 for ONNX tensor: 1361 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_599 [Gather] outputs: [1361 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_600 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_600 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_600 [Constant] outputs: [1362 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_601 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1361 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1362 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_601 [Mul] inputs: [1361 -> ()], [1362 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1362 for ONNX initializer: 1362 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_601 for ONNX node: Mul_601 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1363 for ONNX tensor: 1363 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_601 [Mul] outputs: [1363 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_602 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_602 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_602 for ONNX node: Shape_602 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1364 for ONNX tensor: 1364 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_602 [Shape] outputs: [1364 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_603 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_603 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_603 [Constant] outputs: [1365 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_604 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1364 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1365 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_604 [Gather] inputs: [1364 -> (4)], [1365 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1365 for ONNX initializer: 1365 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_604 for ONNX node: Gather_604 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1366 for ONNX tensor: 1366 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_604 [Gather] outputs: [1366 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_605 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1363 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1366 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_605 [Mul] inputs: [1363 -> ()], [1366 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_605 for ONNX node: Mul_605 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1367 for ONNX tensor: 1367 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_605 [Mul] outputs: [1367 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_606 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1358 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_606 [Unsqueeze] inputs: [1358 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_606 for ONNX node: Unsqueeze_606 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1369 for ONNX tensor: 1369 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_606 [Unsqueeze] outputs: [1369 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_607 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1367 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_607 [Unsqueeze] inputs: [1367 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_607 for ONNX node: Unsqueeze_607 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1370 for ONNX tensor: 1370 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_607 [Unsqueeze] outputs: [1370 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_608 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1369 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1370 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2731 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_608 [Concat] inputs: [1369 -> (1)], [1370 -> (1)], [2731 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2731 for ONNX initializer: 2731 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_608 for ONNX node: Concat_608 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1372 for ONNX tensor: 1372 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_608 [Concat] outputs: [1372 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_609 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1355 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1372 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_609 [Reshape] inputs: [1355 -> (-1, -1, -1, -1)], [1372 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_609 for ONNX node: Reshape_609 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1373 for ONNX tensor: 1373 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_609 [Reshape] outputs: [1373 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_610 [Sigmoid] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1317 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sigmoid_610 [Sigmoid] inputs: [1317 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sigmoid_610 for ONNX node: Sigmoid_610 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1374 for ONNX tensor: 1374 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sigmoid_610 [Sigmoid] outputs: [1374 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_611 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_611 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_611 [Constant] outputs: [1375 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_612 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1374 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1375 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_612 [Mul] inputs: [1374 -> (1, 6, 64, 64)], [1375 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1375 for ONNX initializer: 1375 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_612 for ONNX node: Mul_612 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1376 for ONNX tensor: 1376 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_612 [Mul] outputs: [1376 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_613 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_613 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_613 [Constant] outputs: [1377 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_614 [Sub] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1376 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1377 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sub_614 [Sub] inputs: [1376 -> (1, 6, 64, 64)], [1377 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1377 for ONNX initializer: 1377 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sub_614 for ONNX node: Sub_614 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1378 for ONNX tensor: 1378 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sub_614 [Sub] outputs: [1378 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Exp_615 [Exp] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1318 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Exp_615 [Exp] inputs: [1318 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Exp_615 for ONNX node: Exp_615 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1379 for ONNX tensor: 1379 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Exp_615 [Exp] outputs: [1379 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_616 [Sigmoid] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1335 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sigmoid_616 [Sigmoid] inputs: [1335 -> (-1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sigmoid_616 for ONNX node: Sigmoid_616 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1380 for ONNX tensor: 1380 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sigmoid_616 [Sigmoid] outputs: [1380 -> (-1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_617 [Sigmoid] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1373 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sigmoid_617 [Sigmoid] inputs: [1373 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sigmoid_617 for ONNX node: Sigmoid_617 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1381 for ONNX tensor: 1381 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sigmoid_617 [Sigmoid] outputs: [1381 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_618 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_618 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_618 [Constant] outputs: [1382 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_619 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_619 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_619 [Constant] outputs: [1383 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_620 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_620 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_620 [Constant] outputs: [1384 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_621 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_621 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_621 [Constant] outputs: [1385 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_622 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1378 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1383 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1384 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1382 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1385 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_622 [Slice] inputs: [1378 -> (1, 6, 64, 64)], [1383 -> (1)], [1384 -> (1)], [1382 -> (1)], [1385 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_622 for ONNX node: Slice_622 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1386 for ONNX tensor: 1386 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_622 [Slice] outputs: [1386 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_623 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_623 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_623 [Constant] outputs: [1387 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_624 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1386 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1387 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_624 [Add] inputs: [1386 -> (1, 1, 64, 64)], [1387 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1387 for ONNX initializer: 1387 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_624 for ONNX node: Add_624 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1388 for ONNX tensor: 1388 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_624 [Add] outputs: [1388 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_625 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_625 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_625 [Constant] outputs: [1389 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_626 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_626 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_626 [Constant] outputs: [1390 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_627 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_627 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_627 [Constant] outputs: [1391 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_628 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_628 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_628 [Constant] outputs: [1392 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_629 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1378 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1390 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1391 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1389 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1392 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_629 [Slice] inputs: [1378 -> (1, 6, 64, 64)], [1390 -> (1)], [1391 -> (1)], [1389 -> (1)], [1392 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_629 for ONNX node: Slice_629 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1393 for ONNX tensor: 1393 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_629 [Slice] outputs: [1393 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_630 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_630 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_630 [Constant] outputs: [1394 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_631 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1393 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1394 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_631 [Add] inputs: [1393 -> (1, 1, 64, 64)], [1394 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1394 for ONNX initializer: 1394 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_631 for ONNX node: Add_631 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1395 for ONNX tensor: 1395 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_631 [Add] outputs: [1395 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_632 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_632 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_632 [Constant] outputs: [1396 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_633 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_633 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_633 [Constant] outputs: [1397 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_634 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_634 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_634 [Constant] outputs: [1398 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_635 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_635 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_635 [Constant] outputs: [1399 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_636 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1379 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1397 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1398 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1396 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1399 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_636 [Slice] inputs: [1379 -> (1, 6, 64, 64)], [1397 -> (1)], [1398 -> (1)], [1396 -> (1)], [1399 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_636 for ONNX node: Slice_636 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1400 for ONNX tensor: 1400 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_636 [Slice] outputs: [1400 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_637 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_637 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_637 [Constant] outputs: [1401 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_638 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1400 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1401 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_638 [Mul] inputs: [1400 -> (1, 1, 64, 64)], [1401 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1401 for ONNX initializer: 1401 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_638 for ONNX node: Mul_638 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1402 for ONNX tensor: 1402 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_638 [Mul] outputs: [1402 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_639 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_639 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_639 [Constant] outputs: [1403 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_640 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_640 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_640 [Constant] outputs: [1404 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_641 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_641 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_641 [Constant] outputs: [1405 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_642 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_642 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_642 [Constant] outputs: [1406 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_643 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1379 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1404 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1405 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1403 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1406 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_643 [Slice] inputs: [1379 -> (1, 6, 64, 64)], [1404 -> (1)], [1405 -> (1)], [1403 -> (1)], [1406 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_643 for ONNX node: Slice_643 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1407 for ONNX tensor: 1407 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_643 [Slice] outputs: [1407 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_644 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_644 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_644 [Constant] outputs: [1408 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_645 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1407 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1408 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_645 [Mul] inputs: [1407 -> (1, 1, 64, 64)], [1408 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1408 for ONNX initializer: 1408 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_645 for ONNX node: Mul_645 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1409 for ONNX tensor: 1409 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_645 [Mul] outputs: [1409 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_646 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_646 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_646 [Constant] outputs: [1410 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_647 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_647 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_647 [Constant] outputs: [1411 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_648 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_648 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_648 [Constant] outputs: [1412 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_649 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_649 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_649 [Constant] outputs: [1413 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_650 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1378 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1411 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1412 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1410 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1413 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_650 [Slice] inputs: [1378 -> (1, 6, 64, 64)], [1411 -> (1)], [1412 -> (1)], [1410 -> (1)], [1413 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_650 for ONNX node: Slice_650 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1414 for ONNX tensor: 1414 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_650 [Slice] outputs: [1414 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_651 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_651 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_651 [Constant] outputs: [1415 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_652 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1414 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1415 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_652 [Add] inputs: [1414 -> (1, 1, 64, 64)], [1415 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1415 for ONNX initializer: 1415 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_652 for ONNX node: Add_652 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1416 for ONNX tensor: 1416 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_652 [Add] outputs: [1416 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_653 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_653 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_653 [Constant] outputs: [1417 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_654 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_654 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_654 [Constant] outputs: [1418 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_655 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_655 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_655 [Constant] outputs: [1419 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_656 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_656 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_656 [Constant] outputs: [1420 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_657 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1378 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1418 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1419 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1417 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1420 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_657 [Slice] inputs: [1378 -> (1, 6, 64, 64)], [1418 -> (1)], [1419 -> (1)], [1417 -> (1)], [1420 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_657 for ONNX node: Slice_657 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1421 for ONNX tensor: 1421 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_657 [Slice] outputs: [1421 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_658 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_658 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_658 [Constant] outputs: [1422 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_659 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1421 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1422 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_659 [Add] inputs: [1421 -> (1, 1, 64, 64)], [1422 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1422 for ONNX initializer: 1422 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_659 for ONNX node: Add_659 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1423 for ONNX tensor: 1423 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_659 [Add] outputs: [1423 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_660 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_660 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_660 [Constant] outputs: [1424 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_661 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_661 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_661 [Constant] outputs: [1425 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_662 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_662 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_662 [Constant] outputs: [1426 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_663 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_663 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_663 [Constant] outputs: [1427 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_664 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1379 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1425 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1426 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1424 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1427 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_664 [Slice] inputs: [1379 -> (1, 6, 64, 64)], [1425 -> (1)], [1426 -> (1)], [1424 -> (1)], [1427 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_664 for ONNX node: Slice_664 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1428 for ONNX tensor: 1428 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_664 [Slice] outputs: [1428 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_665 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_665 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_665 [Constant] outputs: [1429 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_666 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1428 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1429 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_666 [Mul] inputs: [1428 -> (1, 1, 64, 64)], [1429 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1429 for ONNX initializer: 1429 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_666 for ONNX node: Mul_666 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1430 for ONNX tensor: 1430 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_666 [Mul] outputs: [1430 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_667 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_667 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_667 [Constant] outputs: [1431 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_668 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_668 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_668 [Constant] outputs: [1432 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_669 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_669 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_669 [Constant] outputs: [1433 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_670 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_670 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_670 [Constant] outputs: [1434 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_671 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1379 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1432 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1433 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1431 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1434 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_671 [Slice] inputs: [1379 -> (1, 6, 64, 64)], [1432 -> (1)], [1433 -> (1)], [1431 -> (1)], [1434 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_671 for ONNX node: Slice_671 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1435 for ONNX tensor: 1435 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_671 [Slice] outputs: [1435 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_672 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_672 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_672 [Constant] outputs: [1436 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_673 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1435 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1436 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_673 [Mul] inputs: [1435 -> (1, 1, 64, 64)], [1436 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1436 for ONNX initializer: 1436 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_673 for ONNX node: Mul_673 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1437 for ONNX tensor: 1437 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_673 [Mul] outputs: [1437 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_674 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_674 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_674 [Constant] outputs: [1438 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_675 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_675 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_675 [Constant] outputs: [1439 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_676 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_676 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_676 [Constant] outputs: [1440 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_677 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_677 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_677 [Constant] outputs: [1441 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_678 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1378 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1439 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1440 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1438 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1441 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_678 [Slice] inputs: [1378 -> (1, 6, 64, 64)], [1439 -> (1)], [1440 -> (1)], [1438 -> (1)], [1441 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_678 for ONNX node: Slice_678 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1442 for ONNX tensor: 1442 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_678 [Slice] outputs: [1442 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_679 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_679 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_679 [Constant] outputs: [1443 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_680 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1442 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1443 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_680 [Add] inputs: [1442 -> (1, 1, 64, 64)], [1443 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1443 for ONNX initializer: 1443 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_680 for ONNX node: Add_680 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1444 for ONNX tensor: 1444 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_680 [Add] outputs: [1444 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_681 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_681 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_681 [Constant] outputs: [1445 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_682 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_682 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_682 [Constant] outputs: [1446 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_683 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_683 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_683 [Constant] outputs: [1447 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_684 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_684 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_684 [Constant] outputs: [1448 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_685 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1378 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1446 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1447 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1445 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1448 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_685 [Slice] inputs: [1378 -> (1, 6, 64, 64)], [1446 -> (1)], [1447 -> (1)], [1445 -> (1)], [1448 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_685 for ONNX node: Slice_685 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1449 for ONNX tensor: 1449 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_685 [Slice] outputs: [1449 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_686 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_686 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_686 [Constant] outputs: [1450 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_687 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1449 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1450 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_687 [Add] inputs: [1449 -> (1, 1, 64, 64)], [1450 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1450 for ONNX initializer: 1450 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_687 for ONNX node: Add_687 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1451 for ONNX tensor: 1451 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_687 [Add] outputs: [1451 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_688 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_688 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_688 [Constant] outputs: [1452 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_689 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_689 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_689 [Constant] outputs: [1453 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_690 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_690 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_690 [Constant] outputs: [1454 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_691 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_691 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_691 [Constant] outputs: [1455 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_692 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1379 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1453 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1454 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1452 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1455 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_692 [Slice] inputs: [1379 -> (1, 6, 64, 64)], [1453 -> (1)], [1454 -> (1)], [1452 -> (1)], [1455 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_692 for ONNX node: Slice_692 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1456 for ONNX tensor: 1456 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_692 [Slice] outputs: [1456 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_693 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_693 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_693 [Constant] outputs: [1457 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_694 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1456 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1457 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_694 [Mul] inputs: [1456 -> (1, 1, 64, 64)], [1457 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1457 for ONNX initializer: 1457 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_694 for ONNX node: Mul_694 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1458 for ONNX tensor: 1458 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_694 [Mul] outputs: [1458 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_695 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_695 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_695 [Constant] outputs: [1459 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_696 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_696 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_696 [Constant] outputs: [1460 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_697 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_697 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_697 [Constant] outputs: [1461 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_698 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_698 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_698 [Constant] outputs: [1462 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_699 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1379 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1460 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1461 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1459 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1462 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_699 [Slice] inputs: [1379 -> (1, 6, 64, 64)], [1460 -> (1)], [1461 -> (1)], [1459 -> (1)], [1462 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_699 for ONNX node: Slice_699 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1463 for ONNX tensor: 1463 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_699 [Slice] outputs: [1463 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_700 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_700 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_700 [Constant] outputs: [1464 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_701 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1463 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1464 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_701 [Mul] inputs: [1463 -> (1, 1, 64, 64)], [1464 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1464 for ONNX initializer: 1464 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_701 for ONNX node: Mul_701 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1465 for ONNX tensor: 1465 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_701 [Mul] outputs: [1465 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_702 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1388 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1416 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1444 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_702 [Concat] inputs: [1388 -> (1, 1, 64, 64)], [1416 -> (1, 1, 64, 64)], [1444 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_702 for ONNX node: Concat_702 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1466 for ONNX tensor: 1466 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_702 [Concat] outputs: [1466 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_703 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1395 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1423 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1451 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_703 [Concat] inputs: [1395 -> (1, 1, 64, 64)], [1423 -> (1, 1, 64, 64)], [1451 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_703 for ONNX node: Concat_703 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1467 for ONNX tensor: 1467 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_703 [Concat] outputs: [1467 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_704 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1402 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1430 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1458 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_704 [Concat] inputs: [1402 -> (1, 1, 64, 64)], [1430 -> (1, 1, 64, 64)], [1458 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_704 for ONNX node: Concat_704 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1468 for ONNX tensor: 1468 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_704 [Concat] outputs: [1468 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_705 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1409 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1437 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1465 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_705 [Concat] inputs: [1409 -> (1, 1, 64, 64)], [1437 -> (1, 1, 64, 64)], [1465 -> (1, 1, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_705 for ONNX node: Concat_705 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1469 for ONNX tensor: 1469 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_705 [Concat] outputs: [1469 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_706 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1466 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1468 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_706 [Concat] inputs: [1466 -> (1, 3, 64, 64)], [1468 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_706 for ONNX node: Concat_706 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1470 for ONNX tensor: 1470 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_706 [Concat] outputs: [1470 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_707 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1467 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1469 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_707 [Concat] inputs: [1467 -> (1, 3, 64, 64)], [1469 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_707 for ONNX node: Concat_707 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1471 for ONNX tensor: 1471 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_707 [Concat] outputs: [1471 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_708 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_708 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_708 for ONNX node: Shape_708 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1472 for ONNX tensor: 1472 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_708 [Shape] outputs: [1472 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_709 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_709 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_709 [Constant] outputs: [1473 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_710 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1472 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1473 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_710 [Gather] inputs: [1472 -> (4)], [1473 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1473 for ONNX initializer: 1473 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_710 for ONNX node: Gather_710 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1474 for ONNX tensor: 1474 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_710 [Gather] outputs: [1474 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Cast_711 [Cast] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1474 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Cast_711 [Cast] inputs: [1474 -> ()], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Cast_711 for ONNX node: Cast_711 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1475 for ONNX tensor: 1475 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Cast_711 [Cast] outputs: [1475 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Div_712 [Div] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1470 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1475 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Div_712 [Div] inputs: [1470 -> (1, 6, 64, 64)], [1475 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Div_712 for ONNX node: Div_712 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1476 for ONNX tensor: 1476 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Div_712 [Div] outputs: [1476 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_713 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_713 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_713 for ONNX node: Shape_713 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1477 for ONNX tensor: 1477 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_713 [Shape] outputs: [1477 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_714 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_714 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_714 [Constant] outputs: [1478 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_715 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1477 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1478 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_715 [Gather] inputs: [1477 -> (4)], [1478 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1478 for ONNX initializer: 1478 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_715 for ONNX node: Gather_715 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1479 for ONNX tensor: 1479 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_715 [Gather] outputs: [1479 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Cast_716 [Cast] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1479 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Cast_716 [Cast] inputs: [1479 -> ()], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Cast_716 for ONNX node: Cast_716 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1480 for ONNX tensor: 1480 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Cast_716 [Cast] outputs: [1480 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Div_717 [Div] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1471 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1480 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Div_717 [Div] inputs: [1471 -> (1, 6, 64, 64)], [1480 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Div_717 for ONNX node: Div_717 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1481 for ONNX tensor: 1481 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Div_717 [Div] outputs: [1481 -> (1, 6, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_718 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_718 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_718 [Constant] outputs: [1482 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_719 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_719 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_719 [Constant] outputs: [1483 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_720 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_720 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_720 [Constant] outputs: [1484 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_721 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_721 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_721 [Constant] outputs: [1485 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_722 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1476 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1483 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1484 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1482 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1485 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_722 [Slice] inputs: [1476 -> (1, 6, 64, 64)], [1483 -> (1)], [1484 -> (1)], [1482 -> (1)], [1485 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_722 for ONNX node: Slice_722 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1486 for ONNX tensor: 1486 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_722 [Slice] outputs: [1486 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_723 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_723 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_723 for ONNX node: Shape_723 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1487 for ONNX tensor: 1487 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_723 [Shape] outputs: [1487 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_724 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_724 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_724 [Constant] outputs: [1488 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_725 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1487 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1488 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_725 [Gather] inputs: [1487 -> (4)], [1488 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1488 for ONNX initializer: 1488 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_725 for ONNX node: Gather_725 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1489 for ONNX tensor: 1489 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_725 [Gather] outputs: [1489 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_726 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_726 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_726 for ONNX node: Shape_726 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1490 for ONNX tensor: 1490 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_726 [Shape] outputs: [1490 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_727 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_727 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_727 [Constant] outputs: [1491 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_728 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1490 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1491 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_728 [Gather] inputs: [1490 -> (4)], [1491 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1491 for ONNX initializer: 1491 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_728 for ONNX node: Gather_728 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1492 for ONNX tensor: 1492 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_728 [Gather] outputs: [1492 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_729 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_729 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_729 [Constant] outputs: [1493 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_730 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1492 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1493 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_730 [Mul] inputs: [1492 -> ()], [1493 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1493 for ONNX initializer: 1493 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_730 for ONNX node: Mul_730 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1494 for ONNX tensor: 1494 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_730 [Mul] outputs: [1494 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_731 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_731 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_731 for ONNX node: Shape_731 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1495 for ONNX tensor: 1495 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_731 [Shape] outputs: [1495 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_732 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_732 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_732 [Constant] outputs: [1496 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_733 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1495 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1496 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_733 [Gather] inputs: [1495 -> (4)], [1496 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1496 for ONNX initializer: 1496 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_733 for ONNX node: Gather_733 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1497 for ONNX tensor: 1497 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_733 [Gather] outputs: [1497 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_734 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1494 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1497 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_734 [Mul] inputs: [1494 -> ()], [1497 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_734 for ONNX node: Mul_734 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1498 for ONNX tensor: 1498 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_734 [Mul] outputs: [1498 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_735 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1489 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_735 [Unsqueeze] inputs: [1489 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_735 for ONNX node: Unsqueeze_735 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1500 for ONNX tensor: 1500 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_735 [Unsqueeze] outputs: [1500 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_736 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1498 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_736 [Unsqueeze] inputs: [1498 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_736 for ONNX node: Unsqueeze_736 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1501 for ONNX tensor: 1501 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_736 [Unsqueeze] outputs: [1501 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_737 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1500 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1501 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2732 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_737 [Concat] inputs: [1500 -> (1)], [1501 -> (1)], [2732 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2732 for ONNX initializer: 2732 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_737 for ONNX node: Concat_737 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1503 for ONNX tensor: 1503 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_737 [Concat] outputs: [1503 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_738 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1486 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1503 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_738 [Reshape] inputs: [1486 -> (1, 3, 64, 64)], [1503 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_738 for ONNX node: Reshape_738 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1504 for ONNX tensor: 1504 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_738 [Reshape] outputs: [1504 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_739 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_739 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_739 [Constant] outputs: [1505 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_740 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_740 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_740 [Constant] outputs: [1506 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_741 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_741 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_741 [Constant] outputs: [1507 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_742 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_742 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_742 [Constant] outputs: [1508 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_743 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1481 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1506 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1507 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1505 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1508 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_743 [Slice] inputs: [1481 -> (1, 6, 64, 64)], [1506 -> (1)], [1507 -> (1)], [1505 -> (1)], [1508 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_743 for ONNX node: Slice_743 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1509 for ONNX tensor: 1509 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_743 [Slice] outputs: [1509 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_744 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_744 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_744 for ONNX node: Shape_744 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1510 for ONNX tensor: 1510 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_744 [Shape] outputs: [1510 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_745 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_745 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_745 [Constant] outputs: [1511 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_746 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1510 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1511 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_746 [Gather] inputs: [1510 -> (4)], [1511 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1511 for ONNX initializer: 1511 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_746 for ONNX node: Gather_746 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1512 for ONNX tensor: 1512 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_746 [Gather] outputs: [1512 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_747 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_747 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_747 for ONNX node: Shape_747 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1513 for ONNX tensor: 1513 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_747 [Shape] outputs: [1513 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_748 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_748 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_748 [Constant] outputs: [1514 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_749 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1513 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1514 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_749 [Gather] inputs: [1513 -> (4)], [1514 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1514 for ONNX initializer: 1514 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_749 for ONNX node: Gather_749 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1515 for ONNX tensor: 1515 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_749 [Gather] outputs: [1515 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_750 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_750 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_750 [Constant] outputs: [1516 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_751 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1515 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1516 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_751 [Mul] inputs: [1515 -> ()], [1516 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1516 for ONNX initializer: 1516 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_751 for ONNX node: Mul_751 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1517 for ONNX tensor: 1517 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_751 [Mul] outputs: [1517 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_752 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_752 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_752 for ONNX node: Shape_752 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1518 for ONNX tensor: 1518 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_752 [Shape] outputs: [1518 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_753 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_753 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_753 [Constant] outputs: [1519 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_754 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1518 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1519 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_754 [Gather] inputs: [1518 -> (4)], [1519 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1519 for ONNX initializer: 1519 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_754 for ONNX node: Gather_754 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1520 for ONNX tensor: 1520 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_754 [Gather] outputs: [1520 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_755 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1517 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1520 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_755 [Mul] inputs: [1517 -> ()], [1520 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_755 for ONNX node: Mul_755 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1521 for ONNX tensor: 1521 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_755 [Mul] outputs: [1521 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_756 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1512 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_756 [Unsqueeze] inputs: [1512 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_756 for ONNX node: Unsqueeze_756 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1523 for ONNX tensor: 1523 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_756 [Unsqueeze] outputs: [1523 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_757 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1521 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_757 [Unsqueeze] inputs: [1521 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_757 for ONNX node: Unsqueeze_757 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1524 for ONNX tensor: 1524 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_757 [Unsqueeze] outputs: [1524 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_758 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1523 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1524 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2733 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_758 [Concat] inputs: [1523 -> (1)], [1524 -> (1)], [2733 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2733 for ONNX initializer: 2733 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_758 for ONNX node: Concat_758 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1526 for ONNX tensor: 1526 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_758 [Concat] outputs: [1526 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_759 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1509 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1526 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_759 [Reshape] inputs: [1509 -> (1, 3, 64, 64)], [1526 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_759 for ONNX node: Reshape_759 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1527 for ONNX tensor: 1527 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_759 [Reshape] outputs: [1527 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_760 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_760 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_760 [Constant] outputs: [1528 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_761 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_761 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_761 [Constant] outputs: [1529 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_762 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_762 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [06/13/2021-16:48:57] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_762 [Constant] outputs: [1530 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_763 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_763 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_763 [Constant] outputs: [1531 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_764 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1476 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1529 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1530 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1528 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1531 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_764 [Slice] inputs: [1476 -> (1, 6, 64, 64)], [1529 -> (1)], [1530 -> (1)], [1528 -> (1)], [1531 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_764 for ONNX node: Slice_764 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1532 for ONNX tensor: 1532 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_764 [Slice] outputs: [1532 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_765 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_765 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_765 for ONNX node: Shape_765 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1533 for ONNX tensor: 1533 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_765 [Shape] outputs: [1533 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_766 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_766 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_766 [Constant] outputs: [1534 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_767 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1533 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1534 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_767 [Gather] inputs: [1533 -> (4)], [1534 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1534 for ONNX initializer: 1534 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_767 for ONNX node: Gather_767 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1535 for ONNX tensor: 1535 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_767 [Gather] outputs: [1535 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_768 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_768 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_768 for ONNX node: Shape_768 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1536 for ONNX tensor: 1536 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_768 [Shape] outputs: [1536 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_769 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_769 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_769 [Constant] outputs: [1537 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_770 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1536 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1537 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_770 [Gather] inputs: [1536 -> (4)], [1537 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1537 for ONNX initializer: 1537 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_770 for ONNX node: Gather_770 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1538 for ONNX tensor: 1538 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_770 [Gather] outputs: [1538 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_771 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_771 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_771 [Constant] outputs: [1539 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_772 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1538 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1539 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_772 [Mul] inputs: [1538 -> ()], [1539 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1539 for ONNX initializer: 1539 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_772 for ONNX node: Mul_772 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1540 for ONNX tensor: 1540 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_772 [Mul] outputs: [1540 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_773 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_773 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_773 for ONNX node: Shape_773 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1541 for ONNX tensor: 1541 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_773 [Shape] outputs: [1541 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_774 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_774 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_774 [Constant] outputs: [1542 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_775 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1541 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1542 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_775 [Gather] inputs: [1541 -> (4)], [1542 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1542 for ONNX initializer: 1542 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_775 for ONNX node: Gather_775 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1543 for ONNX tensor: 1543 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_775 [Gather] outputs: [1543 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_776 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1540 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1543 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_776 [Mul] inputs: [1540 -> ()], [1543 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_776 for ONNX node: Mul_776 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1544 for ONNX tensor: 1544 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_776 [Mul] outputs: [1544 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_777 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1535 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_777 [Unsqueeze] inputs: [1535 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_777 for ONNX node: Unsqueeze_777 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1546 for ONNX tensor: 1546 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_777 [Unsqueeze] outputs: [1546 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_778 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1544 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_778 [Unsqueeze] inputs: [1544 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_778 for ONNX node: Unsqueeze_778 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1547 for ONNX tensor: 1547 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_778 [Unsqueeze] outputs: [1547 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_779 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1546 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1547 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2734 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_779 [Concat] inputs: [1546 -> (1)], [1547 -> (1)], [2734 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2734 for ONNX initializer: 2734 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_779 for ONNX node: Concat_779 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1549 for ONNX tensor: 1549 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_779 [Concat] outputs: [1549 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_780 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1532 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1549 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_780 [Reshape] inputs: [1532 -> (1, 3, 64, 64)], [1549 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_780 for ONNX node: Reshape_780 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1550 for ONNX tensor: 1550 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_780 [Reshape] outputs: [1550 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_781 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_781 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_781 [Constant] outputs: [1551 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_782 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_782 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_782 [Constant] outputs: [1552 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_783 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_783 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [06/13/2021-16:48:57] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_783 [Constant] outputs: [1553 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_784 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_784 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_784 [Constant] outputs: [1554 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_785 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1481 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1552 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1553 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1551 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1554 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_785 [Slice] inputs: [1481 -> (1, 6, 64, 64)], [1552 -> (1)], [1553 -> (1)], [1551 -> (1)], [1554 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_785 for ONNX node: Slice_785 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1555 for ONNX tensor: 1555 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_785 [Slice] outputs: [1555 -> (1, 3, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_786 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_786 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_786 for ONNX node: Shape_786 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1556 for ONNX tensor: 1556 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_786 [Shape] outputs: [1556 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_787 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_787 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_787 [Constant] outputs: [1557 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_788 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1556 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1557 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_788 [Gather] inputs: [1556 -> (4)], [1557 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1557 for ONNX initializer: 1557 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_788 for ONNX node: Gather_788 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1558 for ONNX tensor: 1558 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_788 [Gather] outputs: [1558 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_789 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_789 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_789 for ONNX node: Shape_789 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1559 for ONNX tensor: 1559 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_789 [Shape] outputs: [1559 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_790 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_790 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_790 [Constant] outputs: [1560 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_791 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1559 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1560 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_791 [Gather] inputs: [1559 -> (4)], [1560 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1560 for ONNX initializer: 1560 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_791 for ONNX node: Gather_791 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1561 for ONNX tensor: 1561 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_791 [Gather] outputs: [1561 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_792 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_792 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_792 [Constant] outputs: [1562 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_793 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1561 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1562 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_793 [Mul] inputs: [1561 -> ()], [1562 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1562 for ONNX initializer: 1562 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_793 for ONNX node: Mul_793 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1563 for ONNX tensor: 1563 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_793 [Mul] outputs: [1563 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_794 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_794 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_794 for ONNX node: Shape_794 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1564 for ONNX tensor: 1564 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_794 [Shape] outputs: [1564 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_795 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_795 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_795 [Constant] outputs: [1565 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_796 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1564 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1565 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_796 [Gather] inputs: [1564 -> (4)], [1565 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1565 for ONNX initializer: 1565 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_796 for ONNX node: Gather_796 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1566 for ONNX tensor: 1566 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_796 [Gather] outputs: [1566 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_797 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1563 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1566 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_797 [Mul] inputs: [1563 -> ()], [1566 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_797 for ONNX node: Mul_797 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1567 for ONNX tensor: 1567 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_797 [Mul] outputs: [1567 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_798 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1558 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_798 [Unsqueeze] inputs: [1558 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_798 for ONNX node: Unsqueeze_798 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1569 for ONNX tensor: 1569 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_798 [Unsqueeze] outputs: [1569 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_799 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1567 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_799 [Unsqueeze] inputs: [1567 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_799 for ONNX node: Unsqueeze_799 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1570 for ONNX tensor: 1570 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_799 [Unsqueeze] outputs: [1570 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_800 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1569 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1570 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2735 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_800 [Concat] inputs: [1569 -> (1)], [1570 -> (1)], [2735 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2735 for ONNX initializer: 2735 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_800 for ONNX node: Concat_800 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1572 for ONNX tensor: 1572 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_800 [Concat] outputs: [1572 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_801 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1555 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1572 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_801 [Reshape] inputs: [1555 -> (1, 3, 64, 64)], [1572 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_801 for ONNX node: Reshape_801 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1573 for ONNX tensor: 1573 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_801 [Reshape] outputs: [1573 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_802 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_802 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_802 [Constant] outputs: [1574 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_803 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1550 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1574 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_803 [Mul] inputs: [1550 -> (-1, -1, -1)], [1574 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1574 for ONNX initializer: 1574 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_803 for ONNX node: Mul_803 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1575 for ONNX tensor: 1575 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_803 [Mul] outputs: [1575 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_804 [Sub] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1504 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1575 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sub_804 [Sub] inputs: [1504 -> (-1, -1, -1)], [1575 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sub_804 for ONNX node: Sub_804 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1576 for ONNX tensor: 1576 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sub_804 [Sub] outputs: [1576 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_805 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_805 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_805 [Constant] outputs: [1577 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_806 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1573 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1577 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_806 [Mul] inputs: [1573 -> (-1, -1, -1)], [1577 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1577 for ONNX initializer: 1577 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_806 for ONNX node: Mul_806 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1578 for ONNX tensor: 1578 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_806 [Mul] outputs: [1578 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_807 [Sub] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1527 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1578 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sub_807 [Sub] inputs: [1527 -> (-1, -1, -1)], [1578 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sub_807 for ONNX node: Sub_807 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1579 for ONNX tensor: 1579 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sub_807 [Sub] outputs: [1579 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_808 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1576 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1550 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_808 [Add] inputs: [1576 -> (-1, -1, -1)], [1550 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_808 for ONNX node: Add_808 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1580 for ONNX tensor: 1580 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_808 [Add] outputs: [1580 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_809 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1579 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1573 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_809 [Add] inputs: [1579 -> (-1, -1, -1)], [1573 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_809 for ONNX node: Add_809 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1581 for ONNX tensor: 1581 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_809 [Add] outputs: [1581 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_810 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1576 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1579 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1580 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1581 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_810 [Concat] inputs: [1576 -> (-1, -1, -1)], [1579 -> (-1, -1, -1)], [1580 -> (-1, -1, -1)], [1581 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_810 for ONNX node: Concat_810 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1582 for ONNX tensor: 1582 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_810 [Concat] outputs: [1582 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_811 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_811 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_811 for ONNX node: Shape_811 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1583 for ONNX tensor: 1583 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_811 [Shape] outputs: [1583 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_812 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_812 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_812 [Constant] outputs: [1584 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_813 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1583 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1584 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_813 [Gather] inputs: [1583 -> (4)], [1584 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1584 for ONNX initializer: 1584 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_813 for ONNX node: Gather_813 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1585 for ONNX tensor: 1585 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_813 [Gather] outputs: [1585 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_814 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_814 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_814 for ONNX node: Shape_814 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1586 for ONNX tensor: 1586 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_814 [Shape] outputs: [1586 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_815 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_815 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_815 [Constant] outputs: [1587 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_816 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1586 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1587 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_816 [Gather] inputs: [1586 -> (4)], [1587 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1587 for ONNX initializer: 1587 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_816 for ONNX node: Gather_816 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1588 for ONNX tensor: 1588 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_816 [Gather] outputs: [1588 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_817 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_817 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_817 [Constant] outputs: [1589 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_818 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1588 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1589 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_818 [Mul] inputs: [1588 -> ()], [1589 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1589 for ONNX initializer: 1589 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_818 for ONNX node: Mul_818 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1590 for ONNX tensor: 1590 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_818 [Mul] outputs: [1590 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_819 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_819 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_819 for ONNX node: Shape_819 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1591 for ONNX tensor: 1591 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_819 [Shape] outputs: [1591 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_820 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_820 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_820 [Constant] outputs: [1592 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_821 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1591 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1592 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_821 [Gather] inputs: [1591 -> (4)], [1592 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1592 for ONNX initializer: 1592 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_821 for ONNX node: Gather_821 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1593 for ONNX tensor: 1593 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_821 [Gather] outputs: [1593 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_822 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1590 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1593 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_822 [Mul] inputs: [1590 -> ()], [1593 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_822 for ONNX node: Mul_822 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1594 for ONNX tensor: 1594 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_822 [Mul] outputs: [1594 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_823 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1585 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_823 [Unsqueeze] inputs: [1585 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_823 for ONNX node: Unsqueeze_823 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1597 for ONNX tensor: 1597 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_823 [Unsqueeze] outputs: [1597 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_824 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1594 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_824 [Unsqueeze] inputs: [1594 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_824 for ONNX node: Unsqueeze_824 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1598 for ONNX tensor: 1598 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_824 [Unsqueeze] outputs: [1598 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_825 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1597 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1598 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2736 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2737 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_825 [Concat] inputs: [1597 -> (1)], [1598 -> (1)], [2736 -> (1)], [2737 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2736 for ONNX initializer: 2736 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2737 for ONNX initializer: 2737 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_825 for ONNX node: Concat_825 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1601 for ONNX tensor: 1601 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_825 [Concat] outputs: [1601 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_826 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1582 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1601 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_826 [Reshape] inputs: [1582 -> (-1, -1, -1)], [1601 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_826 for ONNX node: Reshape_826 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1602 for ONNX tensor: 1602 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_826 [Reshape] outputs: [1602 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_827 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_827 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_827 for ONNX node: Shape_827 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1603 for ONNX tensor: 1603 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_827 [Shape] outputs: [1603 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_828 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_828 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_828 [Constant] outputs: [1604 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_829 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1603 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1604 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_829 [Gather] inputs: [1603 -> (4)], [1604 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1604 for ONNX initializer: 1604 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_829 for ONNX node: Gather_829 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1605 for ONNX tensor: 1605 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_829 [Gather] outputs: [1605 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_830 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_830 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_830 for ONNX node: Shape_830 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1606 for ONNX tensor: 1606 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_830 [Shape] outputs: [1606 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_831 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_831 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_831 [Constant] outputs: [1607 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_832 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1606 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1607 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_832 [Gather] inputs: [1606 -> (4)], [1607 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1607 for ONNX initializer: 1607 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_832 for ONNX node: Gather_832 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1608 for ONNX tensor: 1608 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_832 [Gather] outputs: [1608 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_833 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_833 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_833 [Constant] outputs: [1609 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_834 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1608 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1609 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_834 [Mul] inputs: [1608 -> ()], [1609 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1609 for ONNX initializer: 1609 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_834 for ONNX node: Mul_834 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1610 for ONNX tensor: 1610 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_834 [Mul] outputs: [1610 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_835 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_835 [Shape] inputs: [1256 -> (1, 255, 64, 64)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_835 for ONNX node: Shape_835 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1611 for ONNX tensor: 1611 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_835 [Shape] outputs: [1611 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_836 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_836 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_836 [Constant] outputs: [1612 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_837 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1611 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1612 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_837 [Gather] inputs: [1611 -> (4)], [1612 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1612 for ONNX initializer: 1612 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_837 for ONNX node: Gather_837 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1613 for ONNX tensor: 1613 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_837 [Gather] outputs: [1613 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_838 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1610 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1613 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_838 [Mul] inputs: [1610 -> ()], [1613 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_838 for ONNX node: Mul_838 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1614 for ONNX tensor: 1614 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_838 [Mul] outputs: [1614 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_839 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1605 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_839 [Unsqueeze] inputs: [1605 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_839 for ONNX node: Unsqueeze_839 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1616 for ONNX tensor: 1616 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_839 [Unsqueeze] outputs: [1616 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_840 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1614 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_840 [Unsqueeze] inputs: [1614 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_840 for ONNX node: Unsqueeze_840 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1617 for ONNX tensor: 1617 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_840 [Unsqueeze] outputs: [1617 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_841 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1616 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1617 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2738 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_841 [Concat] inputs: [1616 -> (1)], [1617 -> (1)], [2738 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2738 for ONNX initializer: 2738 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_841 for ONNX node: Concat_841 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1619 for ONNX tensor: 1619 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_841 [Concat] outputs: [1619 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_842 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1380 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1619 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_842 [Reshape] inputs: [1380 -> (-1, -1)], [1619 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_842 for ONNX node: Reshape_842 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1620 for ONNX tensor: 1620 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_842 [Reshape] outputs: [1620 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_843 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1381 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1620 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_843 [Mul] inputs: [1381 -> (-1, -1, -1)], [1620 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_843 for ONNX node: Mul_843 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1621 for ONNX tensor: 1621 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_843 [Mul] outputs: [1621 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_844 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1252 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2680 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2681 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_844 [Conv] inputs: [1252 -> (1, 128, 64, 64)], [2680 -> (256, 128, 3, 3)], [2681 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 128, 64, 64) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_844 for ONNX node: Conv_844 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2679 for ONNX tensor: 2679 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_844 [Conv] outputs: [2679 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_845 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2679 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_845 [LeakyRelu] inputs: [2679 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_845 for ONNX node: LeakyRelu_845 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1624 for ONNX tensor: 1624 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_845 [LeakyRelu] outputs: [1624 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_846 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1624 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1155 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_846 [Concat] inputs: [1624 -> (1, 256, 32, 32)], [1155 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_846 for ONNX node: Concat_846 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1625 for ONNX tensor: 1625 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_846 [Concat] outputs: [1625 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_847 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1625 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2683 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2684 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_847 [Conv] inputs: [1625 -> (1, 512, 32, 32)], [2683 -> (256, 512, 1, 1)], [2684 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_847 for ONNX node: Conv_847 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2682 for ONNX tensor: 2682 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_847 [Conv] outputs: [2682 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_848 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2682 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_848 [LeakyRelu] inputs: [2682 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_848 for ONNX node: LeakyRelu_848 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1628 for ONNX tensor: 1628 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_848 [LeakyRelu] outputs: [1628 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_849 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1628 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2686 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2687 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_849 [Conv] inputs: [1628 -> (1, 256, 32, 32)], [2686 -> (512, 256, 3, 3)], [2687 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_849 for ONNX node: Conv_849 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2685 for ONNX tensor: 2685 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_849 [Conv] outputs: [2685 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_850 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2685 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_850 [LeakyRelu] inputs: [2685 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_850 for ONNX node: LeakyRelu_850 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1631 for ONNX tensor: 1631 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_850 [LeakyRelu] outputs: [1631 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_851 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1631 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2689 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2690 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_851 [Conv] inputs: [1631 -> (1, 512, 32, 32)], [2689 -> (256, 512, 1, 1)], [2690 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_851 for ONNX node: Conv_851 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2688 for ONNX tensor: 2688 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_851 [Conv] outputs: [2688 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_852 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2688 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_852 [LeakyRelu] inputs: [2688 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_852 for ONNX node: LeakyRelu_852 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1634 for ONNX tensor: 1634 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_852 [LeakyRelu] outputs: [1634 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_853 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1634 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2692 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2693 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_853 [Conv] inputs: [1634 -> (1, 256, 32, 32)], [2692 -> (512, 256, 3, 3)], [2693 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_853 for ONNX node: Conv_853 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2691 for ONNX tensor: 2691 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_853 [Conv] outputs: [2691 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_854 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2691 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_854 [LeakyRelu] inputs: [2691 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_854 for ONNX node: LeakyRelu_854 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1637 for ONNX tensor: 1637 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_854 [LeakyRelu] outputs: [1637 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_855 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1637 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2695 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2696 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_855 [Conv] inputs: [1637 -> (1, 512, 32, 32)], [2695 -> (256, 512, 1, 1)], [2696 -> (256)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_855 for ONNX node: Conv_855 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2694 for ONNX tensor: 2694 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_855 [Conv] outputs: [2694 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_856 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2694 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_856 [LeakyRelu] inputs: [2694 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_856 for ONNX node: LeakyRelu_856 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1640 for ONNX tensor: 1640 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_856 [LeakyRelu] outputs: [1640 -> (1, 256, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_857 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1640 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2698 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2699 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_857 [Conv] inputs: [1640 -> (1, 256, 32, 32)], [2698 -> (512, 256, 3, 3)], [2699 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_857 for ONNX node: Conv_857 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2697 for ONNX tensor: 2697 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_857 [Conv] outputs: [2697 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_858 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2697 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_858 [LeakyRelu] inputs: [2697 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_858 for ONNX node: LeakyRelu_858 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1643 for ONNX tensor: 1643 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_858 [LeakyRelu] outputs: [1643 -> (1, 512, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_859 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1643 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: models.149.conv102.weight [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: models.149.conv102.bias [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_859 [Conv] inputs: [1643 -> (1, 512, 32, 32)], [models.149.conv102.weight -> (255, 512, 1, 1)], [models.149.conv102.bias -> (255)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_859 for ONNX node: Conv_859 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 255 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 255, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1644 for ONNX tensor: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_859 [Conv] outputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_860 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_860 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_860 [Constant] outputs: [1645 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_861 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_861 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_861 [Constant] outputs: [1646 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_862 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_862 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_862 [Constant] outputs: [1647 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_863 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_863 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_863 [Constant] outputs: [1648 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_864 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1646 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1647 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1645 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1648 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_864 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1646 -> (1)], [1647 -> (1)], [1645 -> (1)], [1648 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_864 for ONNX node: Slice_864 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1649 for ONNX tensor: 1649 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_864 [Slice] outputs: [1649 -> (1, 2, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_865 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_865 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_865 [Constant] outputs: [1650 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_866 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_866 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_866 [Constant] outputs: [1651 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_867 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_867 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_867 [Constant] outputs: [1652 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_868 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_868 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_868 [Constant] outputs: [1653 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_869 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1651 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1652 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1650 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1653 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_869 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1651 -> (1)], [1652 -> (1)], [1650 -> (1)], [1653 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_869 for ONNX node: Slice_869 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1654 for ONNX tensor: 1654 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_869 [Slice] outputs: [1654 -> (1, 2, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_870 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_870 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_870 [Constant] outputs: [1655 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_871 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_871 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_871 [Constant] outputs: [1656 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_872 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_872 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_872 [Constant] outputs: [1657 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_873 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_873 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_873 [Constant] outputs: [1658 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_874 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1656 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1657 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1655 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1658 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_874 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1656 -> (1)], [1657 -> (1)], [1655 -> (1)], [1658 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_874 for ONNX node: Slice_874 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1659 for ONNX tensor: 1659 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_874 [Slice] outputs: [1659 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_875 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_875 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_875 [Constant] outputs: [1660 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_876 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_876 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_876 [Constant] outputs: [1661 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_877 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_877 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_877 [Constant] outputs: [1662 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_878 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_878 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_878 [Constant] outputs: [1663 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_879 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1661 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1662 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1660 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1663 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_879 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1661 -> (1)], [1662 -> (1)], [1660 -> (1)], [1663 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_879 for ONNX node: Slice_879 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1664 for ONNX tensor: 1664 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_879 [Slice] outputs: [1664 -> (1, 80, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_880 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_880 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_880 [Constant] outputs: [1665 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_881 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_881 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_881 [Constant] outputs: [1666 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_882 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_882 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_882 [Constant] outputs: [1667 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_883 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_883 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_883 [Constant] outputs: [1668 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_884 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1666 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1667 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1665 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1668 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_884 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1666 -> (1)], [1667 -> (1)], [1665 -> (1)], [1668 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_884 for ONNX node: Slice_884 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1669 for ONNX tensor: 1669 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_884 [Slice] outputs: [1669 -> (1, 2, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_885 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_885 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_885 [Constant] outputs: [1670 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_886 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_886 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_886 [Constant] outputs: [1671 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_887 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_887 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_887 [Constant] outputs: [1672 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_888 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_888 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_888 [Constant] outputs: [1673 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_889 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1671 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1672 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1670 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1673 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_889 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1671 -> (1)], [1672 -> (1)], [1670 -> (1)], [1673 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_889 for ONNX node: Slice_889 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1674 for ONNX tensor: 1674 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_889 [Slice] outputs: [1674 -> (1, 2, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_890 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_890 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_890 [Constant] outputs: [1675 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_891 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_891 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_891 [Constant] outputs: [1676 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_892 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_892 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_892 [Constant] outputs: [1677 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_893 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_893 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_893 [Constant] outputs: [1678 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_894 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1676 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1677 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1675 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1678 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_894 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1676 -> (1)], [1677 -> (1)], [1675 -> (1)], [1678 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_894 for ONNX node: Slice_894 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1679 for ONNX tensor: 1679 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_894 [Slice] outputs: [1679 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_895 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_895 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_895 [Constant] outputs: [1680 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_896 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_896 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_896 [Constant] outputs: [1681 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_897 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_897 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_897 [Constant] outputs: [1682 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_898 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_898 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_898 [Constant] outputs: [1683 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_899 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1681 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1682 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1680 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1683 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_899 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1681 -> (1)], [1682 -> (1)], [1680 -> (1)], [1683 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_899 for ONNX node: Slice_899 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1684 for ONNX tensor: 1684 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_899 [Slice] outputs: [1684 -> (1, 80, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_900 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_900 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_900 [Constant] outputs: [1685 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_901 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_901 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_901 [Constant] outputs: [1686 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_902 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_902 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_902 [Constant] outputs: [1687 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_903 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_903 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_903 [Constant] outputs: [1688 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_904 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1686 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1687 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1685 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1688 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_904 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1686 -> (1)], [1687 -> (1)], [1685 -> (1)], [1688 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_904 for ONNX node: Slice_904 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1689 for ONNX tensor: 1689 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_904 [Slice] outputs: [1689 -> (1, 2, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_905 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_905 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_905 [Constant] outputs: [1690 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_906 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_906 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_906 [Constant] outputs: [1691 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_907 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_907 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_907 [Constant] outputs: [1692 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_908 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_908 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_908 [Constant] outputs: [1693 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_909 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1691 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1692 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1690 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1693 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_909 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1691 -> (1)], [1692 -> (1)], [1690 -> (1)], [1693 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_909 for ONNX node: Slice_909 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1694 for ONNX tensor: 1694 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_909 [Slice] outputs: [1694 -> (1, 2, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_910 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_910 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_910 [Constant] outputs: [1695 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_911 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_911 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_911 [Constant] outputs: [1696 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_912 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_912 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_912 [Constant] outputs: [1697 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_913 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_913 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_913 [Constant] outputs: [1698 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_914 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1696 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1697 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1695 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1698 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_914 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1696 -> (1)], [1697 -> (1)], [1695 -> (1)], [1698 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_914 for ONNX node: Slice_914 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1699 for ONNX tensor: 1699 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_914 [Slice] outputs: [1699 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_915 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_915 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_915 [Constant] outputs: [1700 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_916 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_916 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_916 [Constant] outputs: [1701 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_917 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_917 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_917 [Constant] outputs: [1702 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_918 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_918 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_918 [Constant] outputs: [1703 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_919 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1701 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1702 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1700 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1703 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_919 [Slice] inputs: [1644 -> (1, 255, 32, 32)], [1701 -> (1)], [1702 -> (1)], [1700 -> (1)], [1703 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_919 for ONNX node: Slice_919 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1704 for ONNX tensor: 1704 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_919 [Slice] outputs: [1704 -> (1, 80, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_920 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1649 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1669 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1689 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_920 [Concat] inputs: [1649 -> (1, 2, 32, 32)], [1669 -> (1, 2, 32, 32)], [1689 -> (1, 2, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_920 for ONNX node: Concat_920 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1705 for ONNX tensor: 1705 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_920 [Concat] outputs: [1705 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_921 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1654 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1674 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1694 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_921 [Concat] inputs: [1654 -> (1, 2, 32, 32)], [1674 -> (1, 2, 32, 32)], [1694 -> (1, 2, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_921 for ONNX node: Concat_921 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1706 for ONNX tensor: 1706 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_921 [Concat] outputs: [1706 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_922 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1659 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1679 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1699 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_922 [Concat] inputs: [1659 -> (1, 1, 32, 32)], [1679 -> (1, 1, 32, 32)], [1699 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_922 for ONNX node: Concat_922 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1707 for ONNX tensor: 1707 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_922 [Concat] outputs: [1707 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_923 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_923 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_923 for ONNX node: Shape_923 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1708 for ONNX tensor: 1708 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_923 [Shape] outputs: [1708 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_924 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_924 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_924 [Constant] outputs: [1709 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_925 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1708 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1709 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_925 [Gather] inputs: [1708 -> (4)], [1709 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1709 for ONNX initializer: 1709 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_925 for ONNX node: Gather_925 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1710 for ONNX tensor: 1710 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_925 [Gather] outputs: [1710 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_926 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_926 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_926 for ONNX node: Shape_926 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1711 for ONNX tensor: 1711 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_926 [Shape] outputs: [1711 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_927 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_927 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_927 [Constant] outputs: [1712 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_928 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1711 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1712 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_928 [Gather] inputs: [1711 -> (4)], [1712 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1712 for ONNX initializer: 1712 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_928 for ONNX node: Gather_928 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1713 for ONNX tensor: 1713 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_928 [Gather] outputs: [1713 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_929 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_929 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_929 [Constant] outputs: [1714 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_930 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1713 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1714 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_930 [Mul] inputs: [1713 -> ()], [1714 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1714 for ONNX initializer: 1714 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_930 for ONNX node: Mul_930 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1715 for ONNX tensor: 1715 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_930 [Mul] outputs: [1715 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_931 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_931 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_931 for ONNX node: Shape_931 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1716 for ONNX tensor: 1716 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_931 [Shape] outputs: [1716 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_932 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_932 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_932 [Constant] outputs: [1717 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_933 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1716 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1717 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_933 [Gather] inputs: [1716 -> (4)], [1717 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1717 for ONNX initializer: 1717 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_933 for ONNX node: Gather_933 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1718 for ONNX tensor: 1718 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_933 [Gather] outputs: [1718 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_934 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1715 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1718 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_934 [Mul] inputs: [1715 -> ()], [1718 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_934 for ONNX node: Mul_934 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1719 for ONNX tensor: 1719 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_934 [Mul] outputs: [1719 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_935 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1710 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_935 [Unsqueeze] inputs: [1710 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_935 for ONNX node: Unsqueeze_935 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1720 for ONNX tensor: 1720 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_935 [Unsqueeze] outputs: [1720 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_936 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1719 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_936 [Unsqueeze] inputs: [1719 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_936 for ONNX node: Unsqueeze_936 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1721 for ONNX tensor: 1721 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_936 [Unsqueeze] outputs: [1721 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_937 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1720 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1721 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_937 [Concat] inputs: [1720 -> (1)], [1721 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_937 for ONNX node: Concat_937 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1722 for ONNX tensor: 1722 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_937 [Concat] outputs: [1722 -> (2)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_938 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1707 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1722 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_938 [Reshape] inputs: [1707 -> (1, 3, 32, 32)], [1722 -> (2)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_938 for ONNX node: Reshape_938 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1723 for ONNX tensor: 1723 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_938 [Reshape] outputs: [1723 -> (-1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_939 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1664 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1684 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1704 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_939 [Concat] inputs: [1664 -> (1, 80, 32, 32)], [1684 -> (1, 80, 32, 32)], [1704 -> (1, 80, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_939 for ONNX node: Concat_939 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1724 for ONNX tensor: 1724 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_939 [Concat] outputs: [1724 -> (1, 240, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_940 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_940 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_940 for ONNX node: Shape_940 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1725 for ONNX tensor: 1725 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_940 [Shape] outputs: [1725 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_941 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_941 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_941 [Constant] outputs: [1726 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_942 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1725 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1726 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_942 [Gather] inputs: [1725 -> (4)], [1726 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1726 for ONNX initializer: 1726 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_942 for ONNX node: Gather_942 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1727 for ONNX tensor: 1727 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_942 [Gather] outputs: [1727 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_943 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_943 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_943 for ONNX node: Shape_943 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1728 for ONNX tensor: 1728 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_943 [Shape] outputs: [1728 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_944 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_944 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_944 [Constant] outputs: [1729 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_945 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1728 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1729 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_945 [Gather] inputs: [1728 -> (4)], [1729 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1729 for ONNX initializer: 1729 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_945 for ONNX node: Gather_945 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1730 for ONNX tensor: 1730 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_945 [Gather] outputs: [1730 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_946 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_946 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_946 for ONNX node: Shape_946 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1731 for ONNX tensor: 1731 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_946 [Shape] outputs: [1731 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_947 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_947 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_947 [Constant] outputs: [1732 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_948 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1731 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1732 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_948 [Gather] inputs: [1731 -> (4)], [1732 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1732 for ONNX initializer: 1732 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_948 for ONNX node: Gather_948 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1733 for ONNX tensor: 1733 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_948 [Gather] outputs: [1733 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_949 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1730 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1733 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_949 [Mul] inputs: [1730 -> ()], [1733 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_949 for ONNX node: Mul_949 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1734 for ONNX tensor: 1734 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_949 [Mul] outputs: [1734 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_950 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1727 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_950 [Unsqueeze] inputs: [1727 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_950 for ONNX node: Unsqueeze_950 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1737 for ONNX tensor: 1737 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_950 [Unsqueeze] outputs: [1737 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_951 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1734 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_951 [Unsqueeze] inputs: [1734 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_951 for ONNX node: Unsqueeze_951 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1740 for ONNX tensor: 1740 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_951 [Unsqueeze] outputs: [1740 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_952 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1737 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2739 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2740 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1740 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_952 [Concat] inputs: [1737 -> (1)], [2739 -> (1)], [2740 -> (1)], [1740 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2739 for ONNX initializer: 2739 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2740 for ONNX initializer: 2740 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_952 for ONNX node: Concat_952 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1741 for ONNX tensor: 1741 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_952 [Concat] outputs: [1741 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_953 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1724 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1741 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_953 [Reshape] inputs: [1724 -> (1, 240, 32, 32)], [1741 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_953 for ONNX node: Reshape_953 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1742 for ONNX tensor: 1742 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_953 [Reshape] outputs: [1742 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_954 [Transpose] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1742 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Transpose_954 [Transpose] inputs: [1742 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_954 for ONNX node: Transpose_954 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1743 for ONNX tensor: 1743 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Transpose_954 [Transpose] outputs: [1743 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_955 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_955 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_955 for ONNX node: Shape_955 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1744 for ONNX tensor: 1744 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_955 [Shape] outputs: [1744 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_956 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_956 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_956 [Constant] outputs: [1745 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_957 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1744 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1745 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_957 [Gather] inputs: [1744 -> (4)], [1745 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1745 for ONNX initializer: 1745 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_957 for ONNX node: Gather_957 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1746 for ONNX tensor: 1746 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_957 [Gather] outputs: [1746 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_958 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_958 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_958 for ONNX node: Shape_958 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1747 for ONNX tensor: 1747 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_958 [Shape] outputs: [1747 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_959 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_959 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_959 [Constant] outputs: [1748 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_960 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1747 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1748 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_960 [Gather] inputs: [1747 -> (4)], [1748 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1748 for ONNX initializer: 1748 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_960 for ONNX node: Gather_960 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1749 for ONNX tensor: 1749 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_960 [Gather] outputs: [1749 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_961 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_961 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_961 [Constant] outputs: [1750 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_962 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1749 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1750 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_962 [Mul] inputs: [1749 -> ()], [1750 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1750 for ONNX initializer: 1750 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_962 for ONNX node: Mul_962 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1751 for ONNX tensor: 1751 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_962 [Mul] outputs: [1751 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_963 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_963 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_963 for ONNX node: Shape_963 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1752 for ONNX tensor: 1752 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_963 [Shape] outputs: [1752 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_964 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_964 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_964 [Constant] outputs: [1753 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_965 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1752 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1753 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_965 [Gather] inputs: [1752 -> (4)], [1753 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1753 for ONNX initializer: 1753 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_965 for ONNX node: Gather_965 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1754 for ONNX tensor: 1754 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_965 [Gather] outputs: [1754 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_966 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1751 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1754 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_966 [Mul] inputs: [1751 -> ()], [1754 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_966 for ONNX node: Mul_966 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1755 for ONNX tensor: 1755 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_966 [Mul] outputs: [1755 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_967 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1746 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_967 [Unsqueeze] inputs: [1746 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_967 for ONNX node: Unsqueeze_967 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1757 for ONNX tensor: 1757 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_967 [Unsqueeze] outputs: [1757 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_968 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1755 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_968 [Unsqueeze] inputs: [1755 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_968 for ONNX node: Unsqueeze_968 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1758 for ONNX tensor: 1758 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_968 [Unsqueeze] outputs: [1758 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_969 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1757 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1758 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2741 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_969 [Concat] inputs: [1757 -> (1)], [1758 -> (1)], [2741 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2741 for ONNX initializer: 2741 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_969 for ONNX node: Concat_969 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1760 for ONNX tensor: 1760 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_969 [Concat] outputs: [1760 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_970 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1743 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1760 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_970 [Reshape] inputs: [1743 -> (-1, -1, -1, -1)], [1760 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_970 for ONNX node: Reshape_970 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1761 for ONNX tensor: 1761 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_970 [Reshape] outputs: [1761 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_971 [Sigmoid] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1705 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sigmoid_971 [Sigmoid] inputs: [1705 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sigmoid_971 for ONNX node: Sigmoid_971 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1762 for ONNX tensor: 1762 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sigmoid_971 [Sigmoid] outputs: [1762 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_972 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_972 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_972 [Constant] outputs: [1763 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_973 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1762 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1763 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_973 [Mul] inputs: [1762 -> (1, 6, 32, 32)], [1763 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1763 for ONNX initializer: 1763 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_973 for ONNX node: Mul_973 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1764 for ONNX tensor: 1764 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_973 [Mul] outputs: [1764 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_974 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_974 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_974 [Constant] outputs: [1765 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_975 [Sub] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1764 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1765 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sub_975 [Sub] inputs: [1764 -> (1, 6, 32, 32)], [1765 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1765 for ONNX initializer: 1765 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sub_975 for ONNX node: Sub_975 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1766 for ONNX tensor: 1766 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sub_975 [Sub] outputs: [1766 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Exp_976 [Exp] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1706 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Exp_976 [Exp] inputs: [1706 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Exp_976 for ONNX node: Exp_976 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1767 for ONNX tensor: 1767 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Exp_976 [Exp] outputs: [1767 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_977 [Sigmoid] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1723 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sigmoid_977 [Sigmoid] inputs: [1723 -> (-1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sigmoid_977 for ONNX node: Sigmoid_977 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1768 for ONNX tensor: 1768 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sigmoid_977 [Sigmoid] outputs: [1768 -> (-1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_978 [Sigmoid] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1761 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sigmoid_978 [Sigmoid] inputs: [1761 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sigmoid_978 for ONNX node: Sigmoid_978 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1769 for ONNX tensor: 1769 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sigmoid_978 [Sigmoid] outputs: [1769 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_979 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_979 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_979 [Constant] outputs: [1770 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_980 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_980 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_980 [Constant] outputs: [1771 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_981 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_981 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_981 [Constant] outputs: [1772 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_982 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_982 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_982 [Constant] outputs: [1773 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_983 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1766 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1771 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1772 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1770 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1773 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_983 [Slice] inputs: [1766 -> (1, 6, 32, 32)], [1771 -> (1)], [1772 -> (1)], [1770 -> (1)], [1773 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_983 for ONNX node: Slice_983 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1774 for ONNX tensor: 1774 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_983 [Slice] outputs: [1774 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_984 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_984 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_984 [Constant] outputs: [1775 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_985 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1774 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1775 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_985 [Add] inputs: [1774 -> (1, 1, 32, 32)], [1775 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1775 for ONNX initializer: 1775 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_985 for ONNX node: Add_985 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1776 for ONNX tensor: 1776 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_985 [Add] outputs: [1776 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_986 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_986 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_986 [Constant] outputs: [1777 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_987 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_987 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_987 [Constant] outputs: [1778 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_988 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_988 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_988 [Constant] outputs: [1779 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_989 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_989 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_989 [Constant] outputs: [1780 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_990 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1766 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1778 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1779 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1777 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1780 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_990 [Slice] inputs: [1766 -> (1, 6, 32, 32)], [1778 -> (1)], [1779 -> (1)], [1777 -> (1)], [1780 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_990 for ONNX node: Slice_990 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1781 for ONNX tensor: 1781 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_990 [Slice] outputs: [1781 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_991 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_991 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_991 [Constant] outputs: [1782 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_992 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1781 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1782 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_992 [Add] inputs: [1781 -> (1, 1, 32, 32)], [1782 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1782 for ONNX initializer: 1782 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_992 for ONNX node: Add_992 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1783 for ONNX tensor: 1783 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_992 [Add] outputs: [1783 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_993 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_993 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_993 [Constant] outputs: [1784 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_994 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_994 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_994 [Constant] outputs: [1785 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_995 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_995 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_995 [Constant] outputs: [1786 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_996 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_996 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_996 [Constant] outputs: [1787 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_997 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1767 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1785 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1786 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1784 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1787 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_997 [Slice] inputs: [1767 -> (1, 6, 32, 32)], [1785 -> (1)], [1786 -> (1)], [1784 -> (1)], [1787 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_997 for ONNX node: Slice_997 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1788 for ONNX tensor: 1788 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_997 [Slice] outputs: [1788 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_998 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_998 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_998 [Constant] outputs: [1789 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_999 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1788 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1789 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_999 [Mul] inputs: [1788 -> (1, 1, 32, 32)], [1789 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1789 for ONNX initializer: 1789 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_999 for ONNX node: Mul_999 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1790 for ONNX tensor: 1790 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_999 [Mul] outputs: [1790 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1000 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1000 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1000 [Constant] outputs: [1791 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1001 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1001 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1001 [Constant] outputs: [1792 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1002 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1002 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1002 [Constant] outputs: [1793 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1003 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1003 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1003 [Constant] outputs: [1794 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1004 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1767 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1792 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1793 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1791 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1794 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1004 [Slice] inputs: [1767 -> (1, 6, 32, 32)], [1792 -> (1)], [1793 -> (1)], [1791 -> (1)], [1794 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1004 for ONNX node: Slice_1004 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1795 for ONNX tensor: 1795 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1004 [Slice] outputs: [1795 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1005 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1005 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1005 [Constant] outputs: [1796 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1006 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1795 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1796 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1006 [Mul] inputs: [1795 -> (1, 1, 32, 32)], [1796 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1796 for ONNX initializer: 1796 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1006 for ONNX node: Mul_1006 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1797 for ONNX tensor: 1797 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1006 [Mul] outputs: [1797 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1007 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1007 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1007 [Constant] outputs: [1798 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1008 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1008 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1008 [Constant] outputs: [1799 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1009 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1009 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1009 [Constant] outputs: [1800 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1010 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1010 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1010 [Constant] outputs: [1801 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1011 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1766 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1799 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1800 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1798 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1801 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1011 [Slice] inputs: [1766 -> (1, 6, 32, 32)], [1799 -> (1)], [1800 -> (1)], [1798 -> (1)], [1801 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1011 for ONNX node: Slice_1011 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1802 for ONNX tensor: 1802 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1011 [Slice] outputs: [1802 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1012 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1012 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1012 [Constant] outputs: [1803 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1013 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1802 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1803 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1013 [Add] inputs: [1802 -> (1, 1, 32, 32)], [1803 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1803 for ONNX initializer: 1803 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1013 for ONNX node: Add_1013 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1804 for ONNX tensor: 1804 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1013 [Add] outputs: [1804 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1014 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1014 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1014 [Constant] outputs: [1805 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1015 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1015 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1015 [Constant] outputs: [1806 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1016 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1016 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1016 [Constant] outputs: [1807 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1017 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1017 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1017 [Constant] outputs: [1808 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1018 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1766 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1806 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1807 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1805 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1808 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1018 [Slice] inputs: [1766 -> (1, 6, 32, 32)], [1806 -> (1)], [1807 -> (1)], [1805 -> (1)], [1808 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1018 for ONNX node: Slice_1018 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1809 for ONNX tensor: 1809 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1018 [Slice] outputs: [1809 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1019 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1019 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1019 [Constant] outputs: [1810 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1020 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1809 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1810 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1020 [Add] inputs: [1809 -> (1, 1, 32, 32)], [1810 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1810 for ONNX initializer: 1810 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1020 for ONNX node: Add_1020 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1811 for ONNX tensor: 1811 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1020 [Add] outputs: [1811 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1021 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1021 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1021 [Constant] outputs: [1812 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1022 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1022 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1022 [Constant] outputs: [1813 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1023 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1023 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1023 [Constant] outputs: [1814 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1024 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1024 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1024 [Constant] outputs: [1815 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1025 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1767 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1813 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1814 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1812 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1815 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1025 [Slice] inputs: [1767 -> (1, 6, 32, 32)], [1813 -> (1)], [1814 -> (1)], [1812 -> (1)], [1815 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1025 for ONNX node: Slice_1025 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1816 for ONNX tensor: 1816 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1025 [Slice] outputs: [1816 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1026 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1026 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1026 [Constant] outputs: [1817 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1027 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1816 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1817 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1027 [Mul] inputs: [1816 -> (1, 1, 32, 32)], [1817 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1817 for ONNX initializer: 1817 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1027 for ONNX node: Mul_1027 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1818 for ONNX tensor: 1818 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1027 [Mul] outputs: [1818 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1028 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1028 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1028 [Constant] outputs: [1819 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1029 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1029 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1029 [Constant] outputs: [1820 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1030 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1030 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1030 [Constant] outputs: [1821 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1031 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1031 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1031 [Constant] outputs: [1822 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1032 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1767 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1820 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1821 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1819 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1822 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1032 [Slice] inputs: [1767 -> (1, 6, 32, 32)], [1820 -> (1)], [1821 -> (1)], [1819 -> (1)], [1822 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1032 for ONNX node: Slice_1032 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1823 for ONNX tensor: 1823 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1032 [Slice] outputs: [1823 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1033 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1033 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1033 [Constant] outputs: [1824 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1034 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1823 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1824 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1034 [Mul] inputs: [1823 -> (1, 1, 32, 32)], [1824 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1824 for ONNX initializer: 1824 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1034 for ONNX node: Mul_1034 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1825 for ONNX tensor: 1825 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1034 [Mul] outputs: [1825 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1035 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1035 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1035 [Constant] outputs: [1826 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1036 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1036 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1036 [Constant] outputs: [1827 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1037 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1037 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1037 [Constant] outputs: [1828 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1038 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1038 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1038 [Constant] outputs: [1829 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1039 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1766 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1827 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1828 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1826 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1829 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1039 [Slice] inputs: [1766 -> (1, 6, 32, 32)], [1827 -> (1)], [1828 -> (1)], [1826 -> (1)], [1829 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1039 for ONNX node: Slice_1039 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1830 for ONNX tensor: 1830 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1039 [Slice] outputs: [1830 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1040 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1040 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1040 [Constant] outputs: [1831 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1041 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1830 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1831 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1041 [Add] inputs: [1830 -> (1, 1, 32, 32)], [1831 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1831 for ONNX initializer: 1831 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1041 for ONNX node: Add_1041 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1832 for ONNX tensor: 1832 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1041 [Add] outputs: [1832 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1042 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1042 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1042 [Constant] outputs: [1833 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1043 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1043 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1043 [Constant] outputs: [1834 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1044 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1044 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1044 [Constant] outputs: [1835 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1045 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1045 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1045 [Constant] outputs: [1836 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1046 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1766 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1834 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1835 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1833 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1836 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1046 [Slice] inputs: [1766 -> (1, 6, 32, 32)], [1834 -> (1)], [1835 -> (1)], [1833 -> (1)], [1836 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1046 for ONNX node: Slice_1046 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1837 for ONNX tensor: 1837 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1046 [Slice] outputs: [1837 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1047 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1047 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1047 [Constant] outputs: [1838 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1048 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1837 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1838 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1048 [Add] inputs: [1837 -> (1, 1, 32, 32)], [1838 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1838 for ONNX initializer: 1838 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1048 for ONNX node: Add_1048 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1839 for ONNX tensor: 1839 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1048 [Add] outputs: [1839 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1049 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1049 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1049 [Constant] outputs: [1840 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1050 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1050 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1050 [Constant] outputs: [1841 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1051 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1051 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1051 [Constant] outputs: [1842 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1052 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1052 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1052 [Constant] outputs: [1843 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1053 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1767 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1841 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1842 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1840 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1843 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1053 [Slice] inputs: [1767 -> (1, 6, 32, 32)], [1841 -> (1)], [1842 -> (1)], [1840 -> (1)], [1843 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1053 for ONNX node: Slice_1053 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1844 for ONNX tensor: 1844 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1053 [Slice] outputs: [1844 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1054 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1054 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1054 [Constant] outputs: [1845 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1055 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1844 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1845 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1055 [Mul] inputs: [1844 -> (1, 1, 32, 32)], [1845 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1845 for ONNX initializer: 1845 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1055 for ONNX node: Mul_1055 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1846 for ONNX tensor: 1846 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1055 [Mul] outputs: [1846 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1056 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1056 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1056 [Constant] outputs: [1847 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1057 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1057 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1057 [Constant] outputs: [1848 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1058 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1058 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1058 [Constant] outputs: [1849 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1059 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1059 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1059 [Constant] outputs: [1850 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1060 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1767 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1848 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1849 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1847 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1850 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1060 [Slice] inputs: [1767 -> (1, 6, 32, 32)], [1848 -> (1)], [1849 -> (1)], [1847 -> (1)], [1850 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1060 for ONNX node: Slice_1060 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1851 for ONNX tensor: 1851 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1060 [Slice] outputs: [1851 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1061 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1061 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1061 [Constant] outputs: [1852 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1062 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1851 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1852 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1062 [Mul] inputs: [1851 -> (1, 1, 32, 32)], [1852 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1852 for ONNX initializer: 1852 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1062 for ONNX node: Mul_1062 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1853 for ONNX tensor: 1853 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1062 [Mul] outputs: [1853 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1063 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1776 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1804 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1832 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1063 [Concat] inputs: [1776 -> (1, 1, 32, 32)], [1804 -> (1, 1, 32, 32)], [1832 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1063 for ONNX node: Concat_1063 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1854 for ONNX tensor: 1854 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1063 [Concat] outputs: [1854 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1064 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1783 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1811 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1839 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1064 [Concat] inputs: [1783 -> (1, 1, 32, 32)], [1811 -> (1, 1, 32, 32)], [1839 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1064 for ONNX node: Concat_1064 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1855 for ONNX tensor: 1855 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1064 [Concat] outputs: [1855 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1065 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1790 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1818 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1846 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1065 [Concat] inputs: [1790 -> (1, 1, 32, 32)], [1818 -> (1, 1, 32, 32)], [1846 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1065 for ONNX node: Concat_1065 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1856 for ONNX tensor: 1856 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1065 [Concat] outputs: [1856 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1066 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1797 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1825 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1853 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1066 [Concat] inputs: [1797 -> (1, 1, 32, 32)], [1825 -> (1, 1, 32, 32)], [1853 -> (1, 1, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1066 for ONNX node: Concat_1066 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1857 for ONNX tensor: 1857 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1066 [Concat] outputs: [1857 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1067 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1854 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1856 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1067 [Concat] inputs: [1854 -> (1, 3, 32, 32)], [1856 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1067 for ONNX node: Concat_1067 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1858 for ONNX tensor: 1858 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1067 [Concat] outputs: [1858 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1068 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1855 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1857 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1068 [Concat] inputs: [1855 -> (1, 3, 32, 32)], [1857 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1068 for ONNX node: Concat_1068 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1859 for ONNX tensor: 1859 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1068 [Concat] outputs: [1859 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1069 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1069 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1069 for ONNX node: Shape_1069 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1860 for ONNX tensor: 1860 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1069 [Shape] outputs: [1860 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1070 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1070 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1070 [Constant] outputs: [1861 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1071 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1860 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1861 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1071 [Gather] inputs: [1860 -> (4)], [1861 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1861 for ONNX initializer: 1861 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1071 for ONNX node: Gather_1071 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1862 for ONNX tensor: 1862 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1071 [Gather] outputs: [1862 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Cast_1072 [Cast] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1862 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Cast_1072 [Cast] inputs: [1862 -> ()], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Cast_1072 for ONNX node: Cast_1072 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1863 for ONNX tensor: 1863 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Cast_1072 [Cast] outputs: [1863 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Div_1073 [Div] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1858 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1863 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Div_1073 [Div] inputs: [1858 -> (1, 6, 32, 32)], [1863 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Div_1073 for ONNX node: Div_1073 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1864 for ONNX tensor: 1864 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Div_1073 [Div] outputs: [1864 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1074 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1074 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1074 for ONNX node: Shape_1074 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1865 for ONNX tensor: 1865 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1074 [Shape] outputs: [1865 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1075 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1075 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1075 [Constant] outputs: [1866 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1076 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1865 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1866 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1076 [Gather] inputs: [1865 -> (4)], [1866 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1866 for ONNX initializer: 1866 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1076 for ONNX node: Gather_1076 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1867 for ONNX tensor: 1867 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1076 [Gather] outputs: [1867 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Cast_1077 [Cast] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1867 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Cast_1077 [Cast] inputs: [1867 -> ()], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Cast_1077 for ONNX node: Cast_1077 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1868 for ONNX tensor: 1868 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Cast_1077 [Cast] outputs: [1868 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Div_1078 [Div] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1859 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1868 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Div_1078 [Div] inputs: [1859 -> (1, 6, 32, 32)], [1868 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Div_1078 for ONNX node: Div_1078 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1869 for ONNX tensor: 1869 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Div_1078 [Div] outputs: [1869 -> (1, 6, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1079 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1079 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1079 [Constant] outputs: [1870 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1080 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1080 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1080 [Constant] outputs: [1871 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1081 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1081 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1081 [Constant] outputs: [1872 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1082 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1082 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1082 [Constant] outputs: [1873 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1083 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1864 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1871 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1872 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1870 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1873 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1083 [Slice] inputs: [1864 -> (1, 6, 32, 32)], [1871 -> (1)], [1872 -> (1)], [1870 -> (1)], [1873 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1083 for ONNX node: Slice_1083 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1874 for ONNX tensor: 1874 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1083 [Slice] outputs: [1874 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1084 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1084 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1084 for ONNX node: Shape_1084 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1875 for ONNX tensor: 1875 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1084 [Shape] outputs: [1875 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1085 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1085 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1085 [Constant] outputs: [1876 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1086 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1875 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1876 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1086 [Gather] inputs: [1875 -> (4)], [1876 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1876 for ONNX initializer: 1876 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1086 for ONNX node: Gather_1086 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1877 for ONNX tensor: 1877 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1086 [Gather] outputs: [1877 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1087 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1087 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1087 for ONNX node: Shape_1087 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1878 for ONNX tensor: 1878 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1087 [Shape] outputs: [1878 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1088 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1088 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1088 [Constant] outputs: [1879 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1089 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1878 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1879 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1089 [Gather] inputs: [1878 -> (4)], [1879 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1879 for ONNX initializer: 1879 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1089 for ONNX node: Gather_1089 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1880 for ONNX tensor: 1880 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1089 [Gather] outputs: [1880 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1090 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1090 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1090 [Constant] outputs: [1881 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1091 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1880 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1881 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1091 [Mul] inputs: [1880 -> ()], [1881 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1881 for ONNX initializer: 1881 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1091 for ONNX node: Mul_1091 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1882 for ONNX tensor: 1882 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1091 [Mul] outputs: [1882 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1092 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1092 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1092 for ONNX node: Shape_1092 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1883 for ONNX tensor: 1883 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1092 [Shape] outputs: [1883 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1093 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1093 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1093 [Constant] outputs: [1884 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1094 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1883 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1884 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1094 [Gather] inputs: [1883 -> (4)], [1884 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1884 for ONNX initializer: 1884 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1094 for ONNX node: Gather_1094 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1885 for ONNX tensor: 1885 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1094 [Gather] outputs: [1885 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1095 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1882 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1885 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1095 [Mul] inputs: [1882 -> ()], [1885 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1095 for ONNX node: Mul_1095 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1886 for ONNX tensor: 1886 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1095 [Mul] outputs: [1886 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1096 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1877 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1096 [Unsqueeze] inputs: [1877 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1096 for ONNX node: Unsqueeze_1096 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1888 for ONNX tensor: 1888 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1096 [Unsqueeze] outputs: [1888 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1097 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1886 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1097 [Unsqueeze] inputs: [1886 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1097 for ONNX node: Unsqueeze_1097 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1889 for ONNX tensor: 1889 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1097 [Unsqueeze] outputs: [1889 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1098 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1888 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1889 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2742 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1098 [Concat] inputs: [1888 -> (1)], [1889 -> (1)], [2742 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2742 for ONNX initializer: 2742 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1098 for ONNX node: Concat_1098 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1891 for ONNX tensor: 1891 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1098 [Concat] outputs: [1891 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1099 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1874 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1891 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1099 [Reshape] inputs: [1874 -> (1, 3, 32, 32)], [1891 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1099 for ONNX node: Reshape_1099 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1892 for ONNX tensor: 1892 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1099 [Reshape] outputs: [1892 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1100 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1100 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1100 [Constant] outputs: [1893 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1101 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1101 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1101 [Constant] outputs: [1894 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1102 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1102 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1102 [Constant] outputs: [1895 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1103 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1103 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1103 [Constant] outputs: [1896 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1104 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1869 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1894 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1895 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1893 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1896 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1104 [Slice] inputs: [1869 -> (1, 6, 32, 32)], [1894 -> (1)], [1895 -> (1)], [1893 -> (1)], [1896 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1104 for ONNX node: Slice_1104 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1897 for ONNX tensor: 1897 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1104 [Slice] outputs: [1897 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1105 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1105 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1105 for ONNX node: Shape_1105 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1898 for ONNX tensor: 1898 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1105 [Shape] outputs: [1898 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1106 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1106 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1106 [Constant] outputs: [1899 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1107 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1898 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1899 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1107 [Gather] inputs: [1898 -> (4)], [1899 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1899 for ONNX initializer: 1899 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1107 for ONNX node: Gather_1107 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1900 for ONNX tensor: 1900 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1107 [Gather] outputs: [1900 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1108 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1108 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1108 for ONNX node: Shape_1108 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1901 for ONNX tensor: 1901 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1108 [Shape] outputs: [1901 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1109 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1109 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1109 [Constant] outputs: [1902 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1110 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1901 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1902 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1110 [Gather] inputs: [1901 -> (4)], [1902 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1902 for ONNX initializer: 1902 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1110 for ONNX node: Gather_1110 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1903 for ONNX tensor: 1903 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1110 [Gather] outputs: [1903 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1111 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1111 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1111 [Constant] outputs: [1904 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1112 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1903 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1904 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1112 [Mul] inputs: [1903 -> ()], [1904 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1904 for ONNX initializer: 1904 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1112 for ONNX node: Mul_1112 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1905 for ONNX tensor: 1905 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1112 [Mul] outputs: [1905 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1113 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1113 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1113 for ONNX node: Shape_1113 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1906 for ONNX tensor: 1906 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1113 [Shape] outputs: [1906 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1114 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1114 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1114 [Constant] outputs: [1907 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1115 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1906 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1907 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1115 [Gather] inputs: [1906 -> (4)], [1907 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1907 for ONNX initializer: 1907 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1115 for ONNX node: Gather_1115 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1908 for ONNX tensor: 1908 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1115 [Gather] outputs: [1908 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1116 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1905 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1908 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1116 [Mul] inputs: [1905 -> ()], [1908 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1116 for ONNX node: Mul_1116 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1909 for ONNX tensor: 1909 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1116 [Mul] outputs: [1909 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1117 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1900 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1117 [Unsqueeze] inputs: [1900 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1117 for ONNX node: Unsqueeze_1117 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1911 for ONNX tensor: 1911 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1117 [Unsqueeze] outputs: [1911 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1118 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1909 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1118 [Unsqueeze] inputs: [1909 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1118 for ONNX node: Unsqueeze_1118 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1912 for ONNX tensor: 1912 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1118 [Unsqueeze] outputs: [1912 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1119 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1911 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1912 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2743 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1119 [Concat] inputs: [1911 -> (1)], [1912 -> (1)], [2743 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2743 for ONNX initializer: 2743 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1119 for ONNX node: Concat_1119 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1914 for ONNX tensor: 1914 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1119 [Concat] outputs: [1914 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1120 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1897 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1914 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1120 [Reshape] inputs: [1897 -> (1, 3, 32, 32)], [1914 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1120 for ONNX node: Reshape_1120 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1915 for ONNX tensor: 1915 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1120 [Reshape] outputs: [1915 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1121 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1121 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1121 [Constant] outputs: [1916 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1122 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1122 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1122 [Constant] outputs: [1917 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1123 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1123 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [06/13/2021-16:48:57] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1123 [Constant] outputs: [1918 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1124 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1124 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1124 [Constant] outputs: [1919 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1125 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1864 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1917 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1918 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1916 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1919 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1125 [Slice] inputs: [1864 -> (1, 6, 32, 32)], [1917 -> (1)], [1918 -> (1)], [1916 -> (1)], [1919 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1125 for ONNX node: Slice_1125 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1920 for ONNX tensor: 1920 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1125 [Slice] outputs: [1920 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1126 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1126 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1126 for ONNX node: Shape_1126 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1921 for ONNX tensor: 1921 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1126 [Shape] outputs: [1921 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1127 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1127 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1127 [Constant] outputs: [1922 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1128 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1921 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1922 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1128 [Gather] inputs: [1921 -> (4)], [1922 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1922 for ONNX initializer: 1922 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1128 for ONNX node: Gather_1128 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1923 for ONNX tensor: 1923 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1128 [Gather] outputs: [1923 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1129 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1129 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1129 for ONNX node: Shape_1129 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1924 for ONNX tensor: 1924 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1129 [Shape] outputs: [1924 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1130 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1130 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1130 [Constant] outputs: [1925 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1131 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1924 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1925 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1131 [Gather] inputs: [1924 -> (4)], [1925 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1925 for ONNX initializer: 1925 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1131 for ONNX node: Gather_1131 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1926 for ONNX tensor: 1926 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1131 [Gather] outputs: [1926 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1132 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1132 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1132 [Constant] outputs: [1927 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1133 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1926 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1927 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1133 [Mul] inputs: [1926 -> ()], [1927 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1927 for ONNX initializer: 1927 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1133 for ONNX node: Mul_1133 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1928 for ONNX tensor: 1928 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1133 [Mul] outputs: [1928 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1134 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1134 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1134 for ONNX node: Shape_1134 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1929 for ONNX tensor: 1929 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1134 [Shape] outputs: [1929 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1135 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1135 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1135 [Constant] outputs: [1930 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1136 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1929 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1930 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1136 [Gather] inputs: [1929 -> (4)], [1930 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1930 for ONNX initializer: 1930 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1136 for ONNX node: Gather_1136 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1931 for ONNX tensor: 1931 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1136 [Gather] outputs: [1931 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1137 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1928 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1931 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1137 [Mul] inputs: [1928 -> ()], [1931 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1137 for ONNX node: Mul_1137 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1932 for ONNX tensor: 1932 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1137 [Mul] outputs: [1932 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1138 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1923 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1138 [Unsqueeze] inputs: [1923 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1138 for ONNX node: Unsqueeze_1138 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1934 for ONNX tensor: 1934 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1138 [Unsqueeze] outputs: [1934 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1139 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1932 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1139 [Unsqueeze] inputs: [1932 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1139 for ONNX node: Unsqueeze_1139 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1935 for ONNX tensor: 1935 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1139 [Unsqueeze] outputs: [1935 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1140 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1934 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1935 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2744 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1140 [Concat] inputs: [1934 -> (1)], [1935 -> (1)], [2744 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2744 for ONNX initializer: 2744 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1140 for ONNX node: Concat_1140 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1937 for ONNX tensor: 1937 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1140 [Concat] outputs: [1937 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1141 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1920 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1937 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1141 [Reshape] inputs: [1920 -> (1, 3, 32, 32)], [1937 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1141 for ONNX node: Reshape_1141 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1938 for ONNX tensor: 1938 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1141 [Reshape] outputs: [1938 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1142 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1142 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1142 [Constant] outputs: [1939 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1143 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1143 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1143 [Constant] outputs: [1940 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1144 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1144 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [06/13/2021-16:48:57] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1144 [Constant] outputs: [1941 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1145 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1145 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1145 [Constant] outputs: [1942 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1146 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1869 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1940 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1941 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1939 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1942 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1146 [Slice] inputs: [1869 -> (1, 6, 32, 32)], [1940 -> (1)], [1941 -> (1)], [1939 -> (1)], [1942 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1146 for ONNX node: Slice_1146 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1943 for ONNX tensor: 1943 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1146 [Slice] outputs: [1943 -> (1, 3, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1147 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1147 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1147 for ONNX node: Shape_1147 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1944 for ONNX tensor: 1944 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1147 [Shape] outputs: [1944 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1148 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1148 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1148 [Constant] outputs: [1945 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1149 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1944 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1945 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1149 [Gather] inputs: [1944 -> (4)], [1945 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1945 for ONNX initializer: 1945 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1149 for ONNX node: Gather_1149 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1946 for ONNX tensor: 1946 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1149 [Gather] outputs: [1946 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1150 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1150 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1150 for ONNX node: Shape_1150 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1947 for ONNX tensor: 1947 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1150 [Shape] outputs: [1947 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1151 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1151 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1151 [Constant] outputs: [1948 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1152 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1947 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1948 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1152 [Gather] inputs: [1947 -> (4)], [1948 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1948 for ONNX initializer: 1948 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1152 for ONNX node: Gather_1152 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1949 for ONNX tensor: 1949 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1152 [Gather] outputs: [1949 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1153 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1153 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1153 [Constant] outputs: [1950 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1154 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1949 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1950 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1154 [Mul] inputs: [1949 -> ()], [1950 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1950 for ONNX initializer: 1950 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1154 for ONNX node: Mul_1154 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1951 for ONNX tensor: 1951 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1154 [Mul] outputs: [1951 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1155 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1155 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1155 for ONNX node: Shape_1155 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1952 for ONNX tensor: 1952 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1155 [Shape] outputs: [1952 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1156 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1156 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1156 [Constant] outputs: [1953 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1157 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1952 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1953 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1157 [Gather] inputs: [1952 -> (4)], [1953 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1953 for ONNX initializer: 1953 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1157 for ONNX node: Gather_1157 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1954 for ONNX tensor: 1954 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1157 [Gather] outputs: [1954 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1158 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1951 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1954 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1158 [Mul] inputs: [1951 -> ()], [1954 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1158 for ONNX node: Mul_1158 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1955 for ONNX tensor: 1955 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1158 [Mul] outputs: [1955 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1159 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1946 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1159 [Unsqueeze] inputs: [1946 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1159 for ONNX node: Unsqueeze_1159 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1957 for ONNX tensor: 1957 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1159 [Unsqueeze] outputs: [1957 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1160 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1955 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1160 [Unsqueeze] inputs: [1955 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1160 for ONNX node: Unsqueeze_1160 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1958 for ONNX tensor: 1958 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1160 [Unsqueeze] outputs: [1958 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1161 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1957 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1958 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2745 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1161 [Concat] inputs: [1957 -> (1)], [1958 -> (1)], [2745 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2745 for ONNX initializer: 2745 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1161 for ONNX node: Concat_1161 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1960 for ONNX tensor: 1960 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1161 [Concat] outputs: [1960 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1162 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1943 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1960 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1162 [Reshape] inputs: [1943 -> (1, 3, 32, 32)], [1960 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1162 for ONNX node: Reshape_1162 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1961 for ONNX tensor: 1961 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1162 [Reshape] outputs: [1961 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1163 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1163 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1163 [Constant] outputs: [1962 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1164 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1938 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1962 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1164 [Mul] inputs: [1938 -> (-1, -1, -1)], [1962 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1962 for ONNX initializer: 1962 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1164 for ONNX node: Mul_1164 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1963 for ONNX tensor: 1963 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1164 [Mul] outputs: [1963 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_1165 [Sub] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1892 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1963 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sub_1165 [Sub] inputs: [1892 -> (-1, -1, -1)], [1963 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sub_1165 for ONNX node: Sub_1165 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1964 for ONNX tensor: 1964 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sub_1165 [Sub] outputs: [1964 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1166 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1166 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1166 [Constant] outputs: [1965 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1167 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1961 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1965 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1167 [Mul] inputs: [1961 -> (-1, -1, -1)], [1965 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1965 for ONNX initializer: 1965 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1167 for ONNX node: Mul_1167 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1966 for ONNX tensor: 1966 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1167 [Mul] outputs: [1966 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_1168 [Sub] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1915 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1966 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sub_1168 [Sub] inputs: [1915 -> (-1, -1, -1)], [1966 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sub_1168 for ONNX node: Sub_1168 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1967 for ONNX tensor: 1967 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sub_1168 [Sub] outputs: [1967 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1169 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1964 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1938 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1169 [Add] inputs: [1964 -> (-1, -1, -1)], [1938 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1169 for ONNX node: Add_1169 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1968 for ONNX tensor: 1968 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1169 [Add] outputs: [1968 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1170 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1967 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1961 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1170 [Add] inputs: [1967 -> (-1, -1, -1)], [1961 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1170 for ONNX node: Add_1170 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1969 for ONNX tensor: 1969 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1170 [Add] outputs: [1969 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1171 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1964 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1967 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1968 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1969 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1171 [Concat] inputs: [1964 -> (-1, -1, -1)], [1967 -> (-1, -1, -1)], [1968 -> (-1, -1, -1)], [1969 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1171 for ONNX node: Concat_1171 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1970 for ONNX tensor: 1970 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1171 [Concat] outputs: [1970 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1172 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1172 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1172 for ONNX node: Shape_1172 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1971 for ONNX tensor: 1971 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1172 [Shape] outputs: [1971 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1173 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1173 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1173 [Constant] outputs: [1972 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1174 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1971 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1972 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1174 [Gather] inputs: [1971 -> (4)], [1972 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1972 for ONNX initializer: 1972 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1174 for ONNX node: Gather_1174 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1973 for ONNX tensor: 1973 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1174 [Gather] outputs: [1973 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1175 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1175 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1175 for ONNX node: Shape_1175 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1974 for ONNX tensor: 1974 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1175 [Shape] outputs: [1974 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1176 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1176 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1176 [Constant] outputs: [1975 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1177 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1974 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1975 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1177 [Gather] inputs: [1974 -> (4)], [1975 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1975 for ONNX initializer: 1975 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1177 for ONNX node: Gather_1177 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1976 for ONNX tensor: 1976 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1177 [Gather] outputs: [1976 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1178 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1178 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1178 [Constant] outputs: [1977 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1179 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1976 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1977 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1179 [Mul] inputs: [1976 -> ()], [1977 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1977 for ONNX initializer: 1977 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1179 for ONNX node: Mul_1179 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1978 for ONNX tensor: 1978 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1179 [Mul] outputs: [1978 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1180 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1180 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1180 for ONNX node: Shape_1180 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1979 for ONNX tensor: 1979 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1180 [Shape] outputs: [1979 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1181 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1181 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1181 [Constant] outputs: [1980 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1182 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1979 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1980 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1182 [Gather] inputs: [1979 -> (4)], [1980 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1980 for ONNX initializer: 1980 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1182 for ONNX node: Gather_1182 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1981 for ONNX tensor: 1981 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1182 [Gather] outputs: [1981 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1183 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1978 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1981 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1183 [Mul] inputs: [1978 -> ()], [1981 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1183 for ONNX node: Mul_1183 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1982 for ONNX tensor: 1982 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1183 [Mul] outputs: [1982 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1184 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1973 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1184 [Unsqueeze] inputs: [1973 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1184 for ONNX node: Unsqueeze_1184 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1985 for ONNX tensor: 1985 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1184 [Unsqueeze] outputs: [1985 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1185 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1982 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1185 [Unsqueeze] inputs: [1982 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1185 for ONNX node: Unsqueeze_1185 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1986 for ONNX tensor: 1986 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1185 [Unsqueeze] outputs: [1986 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1186 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1985 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1986 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2746 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2747 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1186 [Concat] inputs: [1985 -> (1)], [1986 -> (1)], [2746 -> (1)], [2747 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2746 for ONNX initializer: 2746 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2747 for ONNX initializer: 2747 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1186 for ONNX node: Concat_1186 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1989 for ONNX tensor: 1989 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1186 [Concat] outputs: [1989 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1187 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1970 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1989 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1187 [Reshape] inputs: [1970 -> (-1, -1, -1)], [1989 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1187 for ONNX node: Reshape_1187 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1990 for ONNX tensor: 1990 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1187 [Reshape] outputs: [1990 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1188 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1188 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1188 for ONNX node: Shape_1188 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1991 for ONNX tensor: 1991 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1188 [Shape] outputs: [1991 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1189 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1189 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1189 [Constant] outputs: [1992 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1190 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1991 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1992 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1190 [Gather] inputs: [1991 -> (4)], [1992 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1992 for ONNX initializer: 1992 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1190 for ONNX node: Gather_1190 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1993 for ONNX tensor: 1993 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1190 [Gather] outputs: [1993 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1191 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1191 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1191 for ONNX node: Shape_1191 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1994 for ONNX tensor: 1994 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1191 [Shape] outputs: [1994 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1192 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1192 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1192 [Constant] outputs: [1995 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1193 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1994 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1995 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1193 [Gather] inputs: [1994 -> (4)], [1995 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1995 for ONNX initializer: 1995 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1193 for ONNX node: Gather_1193 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1996 for ONNX tensor: 1996 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1193 [Gather] outputs: [1996 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1194 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1194 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1194 [Constant] outputs: [1997 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1195 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1996 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1997 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1195 [Mul] inputs: [1996 -> ()], [1997 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 1997 for ONNX initializer: 1997 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1195 for ONNX node: Mul_1195 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1998 for ONNX tensor: 1998 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1195 [Mul] outputs: [1998 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1196 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1644 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1196 [Shape] inputs: [1644 -> (1, 255, 32, 32)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1196 for ONNX node: Shape_1196 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 1999 for ONNX tensor: 1999 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1196 [Shape] outputs: [1999 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1197 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1197 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1197 [Constant] outputs: [2000 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1198 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1999 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2000 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1198 [Gather] inputs: [1999 -> (4)], [2000 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2000 for ONNX initializer: 2000 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1198 for ONNX node: Gather_1198 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2001 for ONNX tensor: 2001 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1198 [Gather] outputs: [2001 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1199 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1998 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2001 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1199 [Mul] inputs: [1998 -> ()], [2001 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1199 for ONNX node: Mul_1199 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2002 for ONNX tensor: 2002 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1199 [Mul] outputs: [2002 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1200 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1993 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1200 [Unsqueeze] inputs: [1993 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1200 for ONNX node: Unsqueeze_1200 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2004 for ONNX tensor: 2004 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1200 [Unsqueeze] outputs: [2004 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1201 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2002 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1201 [Unsqueeze] inputs: [2002 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1201 for ONNX node: Unsqueeze_1201 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2005 for ONNX tensor: 2005 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1201 [Unsqueeze] outputs: [2005 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1202 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2004 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2005 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2748 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1202 [Concat] inputs: [2004 -> (1)], [2005 -> (1)], [2748 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2748 for ONNX initializer: 2748 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1202 for ONNX node: Concat_1202 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2007 for ONNX tensor: 2007 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1202 [Concat] outputs: [2007 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1203 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1768 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2007 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1203 [Reshape] inputs: [1768 -> (-1, -1)], [2007 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1203 for ONNX node: Reshape_1203 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2008 for ONNX tensor: 2008 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1203 [Reshape] outputs: [2008 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1204 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1769 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2008 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1204 [Mul] inputs: [1769 -> (-1, -1, -1)], [2008 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1204 for ONNX node: Mul_1204 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2009 for ONNX tensor: 2009 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1204 [Mul] outputs: [2009 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_1205 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1640 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2701 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2702 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_1205 [Conv] inputs: [1640 -> (1, 256, 32, 32)], [2701 -> (512, 256, 3, 3)], [2702 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 256, 32, 32) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_1205 for ONNX node: Conv_1205 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2700 for ONNX tensor: 2700 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_1205 [Conv] outputs: [2700 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_1206 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2700 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_1206 [LeakyRelu] inputs: [2700 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_1206 for ONNX node: LeakyRelu_1206 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2012 for ONNX tensor: 2012 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_1206 [LeakyRelu] outputs: [2012 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1207 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2012 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1058 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1207 [Concat] inputs: [2012 -> (1, 512, 16, 16)], [1058 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1207 for ONNX node: Concat_1207 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2013 for ONNX tensor: 2013 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1207 [Concat] outputs: [2013 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_1208 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2013 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2704 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2705 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_1208 [Conv] inputs: [2013 -> (1, 1024, 16, 16)], [2704 -> (512, 1024, 1, 1)], [2705 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_1208 for ONNX node: Conv_1208 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2703 for ONNX tensor: 2703 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_1208 [Conv] outputs: [2703 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_1209 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2703 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_1209 [LeakyRelu] inputs: [2703 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_1209 for ONNX node: LeakyRelu_1209 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2016 for ONNX tensor: 2016 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_1209 [LeakyRelu] outputs: [2016 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_1210 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2016 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2707 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2708 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_1210 [Conv] inputs: [2016 -> (1, 512, 16, 16)], [2707 -> (1024, 512, 3, 3)], [2708 -> (1024)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_1210 for ONNX node: Conv_1210 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1024 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2706 for ONNX tensor: 2706 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_1210 [Conv] outputs: [2706 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_1211 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2706 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_1211 [LeakyRelu] inputs: [2706 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_1211 for ONNX node: LeakyRelu_1211 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2019 for ONNX tensor: 2019 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_1211 [LeakyRelu] outputs: [2019 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_1212 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2019 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2710 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2711 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_1212 [Conv] inputs: [2019 -> (1, 1024, 16, 16)], [2710 -> (512, 1024, 1, 1)], [2711 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_1212 for ONNX node: Conv_1212 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2709 for ONNX tensor: 2709 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_1212 [Conv] outputs: [2709 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_1213 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2709 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_1213 [LeakyRelu] inputs: [2709 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_1213 for ONNX node: LeakyRelu_1213 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2022 for ONNX tensor: 2022 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_1213 [LeakyRelu] outputs: [2022 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_1214 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2022 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2713 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2714 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_1214 [Conv] inputs: [2022 -> (1, 512, 16, 16)], [2713 -> (1024, 512, 3, 3)], [2714 -> (1024)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_1214 for ONNX node: Conv_1214 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1024 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2712 for ONNX tensor: 2712 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_1214 [Conv] outputs: [2712 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_1215 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2712 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_1215 [LeakyRelu] inputs: [2712 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_1215 for ONNX node: LeakyRelu_1215 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2025 for ONNX tensor: 2025 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_1215 [LeakyRelu] outputs: [2025 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_1216 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2025 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2716 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2717 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_1216 [Conv] inputs: [2025 -> (1, 1024, 16, 16)], [2716 -> (512, 1024, 1, 1)], [2717 -> (512)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_1216 for ONNX node: Conv_1216 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2715 for ONNX tensor: 2715 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_1216 [Conv] outputs: [2715 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_1217 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2715 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_1217 [LeakyRelu] inputs: [2715 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_1217 for ONNX node: LeakyRelu_1217 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2028 for ONNX tensor: 2028 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_1217 [LeakyRelu] outputs: [2028 -> (1, 512, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_1218 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2028 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2719 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2720 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_1218 [Conv] inputs: [2028 -> (1, 512, 16, 16)], [2719 -> (1024, 512, 3, 3)], [2720 -> (1024)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 512, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_1218 for ONNX node: Conv_1218 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1024 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2718 for ONNX tensor: 2718 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_1218 [Conv] outputs: [2718 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_1219 [LeakyRelu] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2718 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_1219 [LeakyRelu] inputs: [2718 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_1219 for ONNX node: LeakyRelu_1219 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2031 for ONNX tensor: 2031 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_1219 [LeakyRelu] outputs: [2031 -> (1, 1024, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_1220 [Conv] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2031 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: models.160.conv110.weight [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: models.160.conv110.bias [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Conv_1220 [Conv] inputs: [2031 -> (1, 1024, 16, 16)], [models.160.conv110.weight -> (255, 1024, 1, 1)], [models.160.conv110.bias -> (255)], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (1, 1024, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_1220 for ONNX node: Conv_1220 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 255 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (1, 255, 16, 16) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2032 for ONNX tensor: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Conv_1220 [Conv] outputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1221 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1221 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1221 [Constant] outputs: [2033 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1222 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1222 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1222 [Constant] outputs: [2034 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1223 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1223 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1223 [Constant] outputs: [2035 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1224 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1224 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1224 [Constant] outputs: [2036 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1225 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2034 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2035 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2033 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2036 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1225 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2034 -> (1)], [2035 -> (1)], [2033 -> (1)], [2036 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1225 for ONNX node: Slice_1225 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2037 for ONNX tensor: 2037 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1225 [Slice] outputs: [2037 -> (1, 2, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1226 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1226 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1226 [Constant] outputs: [2038 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1227 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1227 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1227 [Constant] outputs: [2039 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1228 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1228 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1228 [Constant] outputs: [2040 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1229 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1229 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1229 [Constant] outputs: [2041 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1230 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2039 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2040 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2038 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2041 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1230 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2039 -> (1)], [2040 -> (1)], [2038 -> (1)], [2041 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1230 for ONNX node: Slice_1230 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2042 for ONNX tensor: 2042 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1230 [Slice] outputs: [2042 -> (1, 2, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1231 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1231 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1231 [Constant] outputs: [2043 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1232 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1232 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1232 [Constant] outputs: [2044 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1233 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1233 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1233 [Constant] outputs: [2045 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1234 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1234 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1234 [Constant] outputs: [2046 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1235 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2044 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2045 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2043 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2046 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1235 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2044 -> (1)], [2045 -> (1)], [2043 -> (1)], [2046 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1235 for ONNX node: Slice_1235 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2047 for ONNX tensor: 2047 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1235 [Slice] outputs: [2047 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1236 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1236 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1236 [Constant] outputs: [2048 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1237 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1237 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1237 [Constant] outputs: [2049 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1238 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1238 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1238 [Constant] outputs: [2050 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1239 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1239 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1239 [Constant] outputs: [2051 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1240 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2049 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2050 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2048 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2051 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1240 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2049 -> (1)], [2050 -> (1)], [2048 -> (1)], [2051 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1240 for ONNX node: Slice_1240 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2052 for ONNX tensor: 2052 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1240 [Slice] outputs: [2052 -> (1, 80, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1241 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1241 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1241 [Constant] outputs: [2053 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1242 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1242 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1242 [Constant] outputs: [2054 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1243 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1243 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1243 [Constant] outputs: [2055 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1244 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1244 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1244 [Constant] outputs: [2056 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1245 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2054 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2055 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2053 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2056 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1245 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2054 -> (1)], [2055 -> (1)], [2053 -> (1)], [2056 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1245 for ONNX node: Slice_1245 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2057 for ONNX tensor: 2057 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1245 [Slice] outputs: [2057 -> (1, 2, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1246 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1246 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1246 [Constant] outputs: [2058 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1247 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1247 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1247 [Constant] outputs: [2059 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1248 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1248 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1248 [Constant] outputs: [2060 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1249 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1249 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1249 [Constant] outputs: [2061 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1250 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2059 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2060 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2058 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2061 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1250 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2059 -> (1)], [2060 -> (1)], [2058 -> (1)], [2061 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1250 for ONNX node: Slice_1250 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2062 for ONNX tensor: 2062 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1250 [Slice] outputs: [2062 -> (1, 2, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1251 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1251 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1251 [Constant] outputs: [2063 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1252 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1252 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1252 [Constant] outputs: [2064 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1253 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1253 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1253 [Constant] outputs: [2065 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1254 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1254 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1254 [Constant] outputs: [2066 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1255 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2064 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2065 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2063 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2066 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1255 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2064 -> (1)], [2065 -> (1)], [2063 -> (1)], [2066 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1255 for ONNX node: Slice_1255 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2067 for ONNX tensor: 2067 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1255 [Slice] outputs: [2067 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1256 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1256 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1256 [Constant] outputs: [2068 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1257 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1257 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1257 [Constant] outputs: [2069 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1258 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1258 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1258 [Constant] outputs: [2070 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1259 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1259 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1259 [Constant] outputs: [2071 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1260 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2069 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2070 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2068 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2071 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1260 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2069 -> (1)], [2070 -> (1)], [2068 -> (1)], [2071 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1260 for ONNX node: Slice_1260 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2072 for ONNX tensor: 2072 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1260 [Slice] outputs: [2072 -> (1, 80, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1261 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1261 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1261 [Constant] outputs: [2073 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1262 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1262 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1262 [Constant] outputs: [2074 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1263 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1263 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1263 [Constant] outputs: [2075 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1264 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1264 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1264 [Constant] outputs: [2076 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1265 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2074 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2075 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2073 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2076 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1265 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2074 -> (1)], [2075 -> (1)], [2073 -> (1)], [2076 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1265 for ONNX node: Slice_1265 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2077 for ONNX tensor: 2077 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1265 [Slice] outputs: [2077 -> (1, 2, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1266 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1266 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1266 [Constant] outputs: [2078 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1267 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1267 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1267 [Constant] outputs: [2079 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1268 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1268 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1268 [Constant] outputs: [2080 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1269 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1269 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1269 [Constant] outputs: [2081 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1270 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2079 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2080 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2078 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2081 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1270 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2079 -> (1)], [2080 -> (1)], [2078 -> (1)], [2081 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1270 for ONNX node: Slice_1270 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2082 for ONNX tensor: 2082 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1270 [Slice] outputs: [2082 -> (1, 2, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1271 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1271 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1271 [Constant] outputs: [2083 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1272 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1272 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1272 [Constant] outputs: [2084 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1273 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1273 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1273 [Constant] outputs: [2085 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1274 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1274 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1274 [Constant] outputs: [2086 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1275 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2084 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2085 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2083 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2086 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1275 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2084 -> (1)], [2085 -> (1)], [2083 -> (1)], [2086 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1275 for ONNX node: Slice_1275 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2087 for ONNX tensor: 2087 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1275 [Slice] outputs: [2087 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1276 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1276 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1276 [Constant] outputs: [2088 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1277 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1277 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1277 [Constant] outputs: [2089 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1278 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1278 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1278 [Constant] outputs: [2090 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1279 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1279 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1279 [Constant] outputs: [2091 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1280 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2089 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2090 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2088 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2091 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1280 [Slice] inputs: [2032 -> (1, 255, 16, 16)], [2089 -> (1)], [2090 -> (1)], [2088 -> (1)], [2091 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1280 for ONNX node: Slice_1280 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2092 for ONNX tensor: 2092 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1280 [Slice] outputs: [2092 -> (1, 80, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1281 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2037 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2057 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2077 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1281 [Concat] inputs: [2037 -> (1, 2, 16, 16)], [2057 -> (1, 2, 16, 16)], [2077 -> (1, 2, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1281 for ONNX node: Concat_1281 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2093 for ONNX tensor: 2093 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1281 [Concat] outputs: [2093 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1282 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2042 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2062 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2082 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1282 [Concat] inputs: [2042 -> (1, 2, 16, 16)], [2062 -> (1, 2, 16, 16)], [2082 -> (1, 2, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1282 for ONNX node: Concat_1282 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2094 for ONNX tensor: 2094 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1282 [Concat] outputs: [2094 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1283 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2047 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2067 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2087 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1283 [Concat] inputs: [2047 -> (1, 1, 16, 16)], [2067 -> (1, 1, 16, 16)], [2087 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1283 for ONNX node: Concat_1283 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2095 for ONNX tensor: 2095 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1283 [Concat] outputs: [2095 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1284 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1284 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1284 for ONNX node: Shape_1284 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2096 for ONNX tensor: 2096 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1284 [Shape] outputs: [2096 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1285 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1285 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1285 [Constant] outputs: [2097 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1286 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2096 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2097 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1286 [Gather] inputs: [2096 -> (4)], [2097 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2097 for ONNX initializer: 2097 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1286 for ONNX node: Gather_1286 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2098 for ONNX tensor: 2098 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1286 [Gather] outputs: [2098 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1287 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1287 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1287 for ONNX node: Shape_1287 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2099 for ONNX tensor: 2099 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1287 [Shape] outputs: [2099 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1288 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1288 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1288 [Constant] outputs: [2100 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1289 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2099 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2100 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1289 [Gather] inputs: [2099 -> (4)], [2100 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2100 for ONNX initializer: 2100 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1289 for ONNX node: Gather_1289 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2101 for ONNX tensor: 2101 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1289 [Gather] outputs: [2101 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1290 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1290 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1290 [Constant] outputs: [2102 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1291 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2101 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2102 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1291 [Mul] inputs: [2101 -> ()], [2102 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2102 for ONNX initializer: 2102 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1291 for ONNX node: Mul_1291 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2103 for ONNX tensor: 2103 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1291 [Mul] outputs: [2103 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1292 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1292 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1292 for ONNX node: Shape_1292 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2104 for ONNX tensor: 2104 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1292 [Shape] outputs: [2104 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1293 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1293 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1293 [Constant] outputs: [2105 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1294 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2104 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2105 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1294 [Gather] inputs: [2104 -> (4)], [2105 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2105 for ONNX initializer: 2105 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1294 for ONNX node: Gather_1294 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2106 for ONNX tensor: 2106 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1294 [Gather] outputs: [2106 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1295 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2103 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2106 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1295 [Mul] inputs: [2103 -> ()], [2106 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1295 for ONNX node: Mul_1295 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2107 for ONNX tensor: 2107 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1295 [Mul] outputs: [2107 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1296 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2098 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1296 [Unsqueeze] inputs: [2098 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1296 for ONNX node: Unsqueeze_1296 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2108 for ONNX tensor: 2108 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1296 [Unsqueeze] outputs: [2108 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1297 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2107 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1297 [Unsqueeze] inputs: [2107 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1297 for ONNX node: Unsqueeze_1297 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2109 for ONNX tensor: 2109 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1297 [Unsqueeze] outputs: [2109 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1298 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2108 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2109 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1298 [Concat] inputs: [2108 -> (1)], [2109 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1298 for ONNX node: Concat_1298 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2110 for ONNX tensor: 2110 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1298 [Concat] outputs: [2110 -> (2)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1299 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2095 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2110 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1299 [Reshape] inputs: [2095 -> (1, 3, 16, 16)], [2110 -> (2)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1299 for ONNX node: Reshape_1299 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2111 for ONNX tensor: 2111 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1299 [Reshape] outputs: [2111 -> (-1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1300 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2052 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2072 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2092 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1300 [Concat] inputs: [2052 -> (1, 80, 16, 16)], [2072 -> (1, 80, 16, 16)], [2092 -> (1, 80, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1300 for ONNX node: Concat_1300 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2112 for ONNX tensor: 2112 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1300 [Concat] outputs: [2112 -> (1, 240, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1301 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1301 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1301 for ONNX node: Shape_1301 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2113 for ONNX tensor: 2113 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1301 [Shape] outputs: [2113 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1302 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1302 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1302 [Constant] outputs: [2114 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1303 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2113 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2114 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1303 [Gather] inputs: [2113 -> (4)], [2114 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2114 for ONNX initializer: 2114 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1303 for ONNX node: Gather_1303 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2115 for ONNX tensor: 2115 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1303 [Gather] outputs: [2115 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1304 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1304 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1304 for ONNX node: Shape_1304 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2116 for ONNX tensor: 2116 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1304 [Shape] outputs: [2116 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1305 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1305 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1305 [Constant] outputs: [2117 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1306 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2116 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2117 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1306 [Gather] inputs: [2116 -> (4)], [2117 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2117 for ONNX initializer: 2117 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1306 for ONNX node: Gather_1306 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2118 for ONNX tensor: 2118 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1306 [Gather] outputs: [2118 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1307 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1307 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1307 for ONNX node: Shape_1307 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2119 for ONNX tensor: 2119 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1307 [Shape] outputs: [2119 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1308 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1308 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1308 [Constant] outputs: [2120 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1309 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2119 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2120 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1309 [Gather] inputs: [2119 -> (4)], [2120 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2120 for ONNX initializer: 2120 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1309 for ONNX node: Gather_1309 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2121 for ONNX tensor: 2121 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1309 [Gather] outputs: [2121 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1310 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2118 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2121 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1310 [Mul] inputs: [2118 -> ()], [2121 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1310 for ONNX node: Mul_1310 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2122 for ONNX tensor: 2122 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1310 [Mul] outputs: [2122 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1311 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2115 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1311 [Unsqueeze] inputs: [2115 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1311 for ONNX node: Unsqueeze_1311 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2125 for ONNX tensor: 2125 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1311 [Unsqueeze] outputs: [2125 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1312 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2122 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1312 [Unsqueeze] inputs: [2122 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1312 for ONNX node: Unsqueeze_1312 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2128 for ONNX tensor: 2128 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1312 [Unsqueeze] outputs: [2128 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1313 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2125 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2749 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2750 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2128 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1313 [Concat] inputs: [2125 -> (1)], [2749 -> (1)], [2750 -> (1)], [2128 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2749 for ONNX initializer: 2749 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2750 for ONNX initializer: 2750 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1313 for ONNX node: Concat_1313 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2129 for ONNX tensor: 2129 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1313 [Concat] outputs: [2129 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1314 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2112 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2129 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1314 [Reshape] inputs: [2112 -> (1, 240, 16, 16)], [2129 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1314 for ONNX node: Reshape_1314 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2130 for ONNX tensor: 2130 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1314 [Reshape] outputs: [2130 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_1315 [Transpose] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2130 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Transpose_1315 [Transpose] inputs: [2130 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_1315 for ONNX node: Transpose_1315 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2131 for ONNX tensor: 2131 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Transpose_1315 [Transpose] outputs: [2131 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1316 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1316 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1316 for ONNX node: Shape_1316 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2132 for ONNX tensor: 2132 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1316 [Shape] outputs: [2132 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1317 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1317 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1317 [Constant] outputs: [2133 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1318 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2132 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2133 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1318 [Gather] inputs: [2132 -> (4)], [2133 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2133 for ONNX initializer: 2133 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1318 for ONNX node: Gather_1318 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2134 for ONNX tensor: 2134 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1318 [Gather] outputs: [2134 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1319 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1319 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1319 for ONNX node: Shape_1319 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2135 for ONNX tensor: 2135 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1319 [Shape] outputs: [2135 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1320 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1320 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1320 [Constant] outputs: [2136 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1321 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2135 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2136 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1321 [Gather] inputs: [2135 -> (4)], [2136 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2136 for ONNX initializer: 2136 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1321 for ONNX node: Gather_1321 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2137 for ONNX tensor: 2137 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1321 [Gather] outputs: [2137 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1322 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1322 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1322 [Constant] outputs: [2138 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1323 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2137 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2138 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1323 [Mul] inputs: [2137 -> ()], [2138 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2138 for ONNX initializer: 2138 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1323 for ONNX node: Mul_1323 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2139 for ONNX tensor: 2139 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1323 [Mul] outputs: [2139 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1324 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1324 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1324 for ONNX node: Shape_1324 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2140 for ONNX tensor: 2140 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1324 [Shape] outputs: [2140 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1325 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1325 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1325 [Constant] outputs: [2141 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1326 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2140 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2141 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1326 [Gather] inputs: [2140 -> (4)], [2141 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2141 for ONNX initializer: 2141 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1326 for ONNX node: Gather_1326 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2142 for ONNX tensor: 2142 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1326 [Gather] outputs: [2142 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1327 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2139 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2142 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1327 [Mul] inputs: [2139 -> ()], [2142 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1327 for ONNX node: Mul_1327 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2143 for ONNX tensor: 2143 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1327 [Mul] outputs: [2143 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1328 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2134 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1328 [Unsqueeze] inputs: [2134 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1328 for ONNX node: Unsqueeze_1328 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2145 for ONNX tensor: 2145 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1328 [Unsqueeze] outputs: [2145 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1329 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2143 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1329 [Unsqueeze] inputs: [2143 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1329 for ONNX node: Unsqueeze_1329 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2146 for ONNX tensor: 2146 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1329 [Unsqueeze] outputs: [2146 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1330 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2145 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2146 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2751 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1330 [Concat] inputs: [2145 -> (1)], [2146 -> (1)], [2751 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2751 for ONNX initializer: 2751 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1330 for ONNX node: Concat_1330 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2148 for ONNX tensor: 2148 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1330 [Concat] outputs: [2148 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1331 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2131 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2148 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1331 [Reshape] inputs: [2131 -> (-1, -1, -1, -1)], [2148 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1331 for ONNX node: Reshape_1331 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2149 for ONNX tensor: 2149 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1331 [Reshape] outputs: [2149 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_1332 [Sigmoid] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2093 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sigmoid_1332 [Sigmoid] inputs: [2093 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sigmoid_1332 for ONNX node: Sigmoid_1332 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2150 for ONNX tensor: 2150 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sigmoid_1332 [Sigmoid] outputs: [2150 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1333 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1333 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1333 [Constant] outputs: [2151 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1334 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2150 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2151 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1334 [Mul] inputs: [2150 -> (1, 6, 16, 16)], [2151 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2151 for ONNX initializer: 2151 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1334 for ONNX node: Mul_1334 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2152 for ONNX tensor: 2152 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1334 [Mul] outputs: [2152 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1335 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1335 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1335 [Constant] outputs: [2153 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_1336 [Sub] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2152 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2153 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sub_1336 [Sub] inputs: [2152 -> (1, 6, 16, 16)], [2153 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2153 for ONNX initializer: 2153 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sub_1336 for ONNX node: Sub_1336 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2154 for ONNX tensor: 2154 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sub_1336 [Sub] outputs: [2154 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Exp_1337 [Exp] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2094 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Exp_1337 [Exp] inputs: [2094 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Exp_1337 for ONNX node: Exp_1337 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2155 for ONNX tensor: 2155 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Exp_1337 [Exp] outputs: [2155 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_1338 [Sigmoid] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2111 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sigmoid_1338 [Sigmoid] inputs: [2111 -> (-1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sigmoid_1338 for ONNX node: Sigmoid_1338 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2156 for ONNX tensor: 2156 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sigmoid_1338 [Sigmoid] outputs: [2156 -> (-1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sigmoid_1339 [Sigmoid] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2149 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sigmoid_1339 [Sigmoid] inputs: [2149 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sigmoid_1339 for ONNX node: Sigmoid_1339 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2157 for ONNX tensor: 2157 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sigmoid_1339 [Sigmoid] outputs: [2157 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1340 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1340 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1340 [Constant] outputs: [2158 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1341 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1341 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1341 [Constant] outputs: [2159 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1342 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1342 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1342 [Constant] outputs: [2160 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1343 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1343 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1343 [Constant] outputs: [2161 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1344 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2154 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2159 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2160 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2158 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2161 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1344 [Slice] inputs: [2154 -> (1, 6, 16, 16)], [2159 -> (1)], [2160 -> (1)], [2158 -> (1)], [2161 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1344 for ONNX node: Slice_1344 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2162 for ONNX tensor: 2162 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1344 [Slice] outputs: [2162 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1345 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1345 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1345 [Constant] outputs: [2163 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1346 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2162 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2163 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1346 [Add] inputs: [2162 -> (1, 1, 16, 16)], [2163 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2163 for ONNX initializer: 2163 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1346 for ONNX node: Add_1346 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2164 for ONNX tensor: 2164 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1346 [Add] outputs: [2164 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1347 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1347 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1347 [Constant] outputs: [2165 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1348 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1348 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1348 [Constant] outputs: [2166 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1349 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1349 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1349 [Constant] outputs: [2167 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1350 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1350 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1350 [Constant] outputs: [2168 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1351 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2154 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2166 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2167 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2165 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2168 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1351 [Slice] inputs: [2154 -> (1, 6, 16, 16)], [2166 -> (1)], [2167 -> (1)], [2165 -> (1)], [2168 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1351 for ONNX node: Slice_1351 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2169 for ONNX tensor: 2169 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1351 [Slice] outputs: [2169 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1352 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1352 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1352 [Constant] outputs: [2170 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1353 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2169 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2170 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1353 [Add] inputs: [2169 -> (1, 1, 16, 16)], [2170 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2170 for ONNX initializer: 2170 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1353 for ONNX node: Add_1353 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2171 for ONNX tensor: 2171 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1353 [Add] outputs: [2171 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1354 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1354 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1354 [Constant] outputs: [2172 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1355 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1355 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1355 [Constant] outputs: [2173 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1356 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1356 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1356 [Constant] outputs: [2174 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1357 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1357 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1357 [Constant] outputs: [2175 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1358 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2155 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2173 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2174 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2172 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2175 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1358 [Slice] inputs: [2155 -> (1, 6, 16, 16)], [2173 -> (1)], [2174 -> (1)], [2172 -> (1)], [2175 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1358 for ONNX node: Slice_1358 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2176 for ONNX tensor: 2176 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1358 [Slice] outputs: [2176 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1359 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1359 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1359 [Constant] outputs: [2177 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1360 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2176 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2177 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1360 [Mul] inputs: [2176 -> (1, 1, 16, 16)], [2177 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2177 for ONNX initializer: 2177 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1360 for ONNX node: Mul_1360 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2178 for ONNX tensor: 2178 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1360 [Mul] outputs: [2178 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1361 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1361 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1361 [Constant] outputs: [2179 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1362 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1362 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1362 [Constant] outputs: [2180 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1363 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1363 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1363 [Constant] outputs: [2181 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1364 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1364 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1364 [Constant] outputs: [2182 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1365 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2155 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2180 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2181 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2179 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2182 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1365 [Slice] inputs: [2155 -> (1, 6, 16, 16)], [2180 -> (1)], [2181 -> (1)], [2179 -> (1)], [2182 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1365 for ONNX node: Slice_1365 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2183 for ONNX tensor: 2183 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1365 [Slice] outputs: [2183 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1366 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1366 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1366 [Constant] outputs: [2184 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1367 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2183 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2184 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1367 [Mul] inputs: [2183 -> (1, 1, 16, 16)], [2184 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2184 for ONNX initializer: 2184 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1367 for ONNX node: Mul_1367 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2185 for ONNX tensor: 2185 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1367 [Mul] outputs: [2185 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1368 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1368 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1368 [Constant] outputs: [2186 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1369 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1369 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1369 [Constant] outputs: [2187 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1370 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1370 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1370 [Constant] outputs: [2188 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1371 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1371 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1371 [Constant] outputs: [2189 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1372 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2154 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2187 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2188 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2186 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2189 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1372 [Slice] inputs: [2154 -> (1, 6, 16, 16)], [2187 -> (1)], [2188 -> (1)], [2186 -> (1)], [2189 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1372 for ONNX node: Slice_1372 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2190 for ONNX tensor: 2190 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1372 [Slice] outputs: [2190 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1373 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1373 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1373 [Constant] outputs: [2191 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1374 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2190 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2191 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1374 [Add] inputs: [2190 -> (1, 1, 16, 16)], [2191 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2191 for ONNX initializer: 2191 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1374 for ONNX node: Add_1374 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2192 for ONNX tensor: 2192 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1374 [Add] outputs: [2192 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1375 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1375 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1375 [Constant] outputs: [2193 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1376 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1376 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1376 [Constant] outputs: [2194 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1377 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1377 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1377 [Constant] outputs: [2195 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1378 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1378 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1378 [Constant] outputs: [2196 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1379 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2154 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2194 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2195 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2193 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2196 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1379 [Slice] inputs: [2154 -> (1, 6, 16, 16)], [2194 -> (1)], [2195 -> (1)], [2193 -> (1)], [2196 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1379 for ONNX node: Slice_1379 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2197 for ONNX tensor: 2197 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1379 [Slice] outputs: [2197 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1380 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1380 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1380 [Constant] outputs: [2198 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1381 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2197 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2198 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1381 [Add] inputs: [2197 -> (1, 1, 16, 16)], [2198 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2198 for ONNX initializer: 2198 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1381 for ONNX node: Add_1381 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2199 for ONNX tensor: 2199 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1381 [Add] outputs: [2199 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1382 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1382 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1382 [Constant] outputs: [2200 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1383 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1383 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1383 [Constant] outputs: [2201 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1384 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1384 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1384 [Constant] outputs: [2202 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1385 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1385 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1385 [Constant] outputs: [2203 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1386 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2155 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2201 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2202 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2200 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2203 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1386 [Slice] inputs: [2155 -> (1, 6, 16, 16)], [2201 -> (1)], [2202 -> (1)], [2200 -> (1)], [2203 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1386 for ONNX node: Slice_1386 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2204 for ONNX tensor: 2204 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1386 [Slice] outputs: [2204 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1387 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1387 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1387 [Constant] outputs: [2205 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1388 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2204 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2205 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1388 [Mul] inputs: [2204 -> (1, 1, 16, 16)], [2205 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2205 for ONNX initializer: 2205 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1388 for ONNX node: Mul_1388 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2206 for ONNX tensor: 2206 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1388 [Mul] outputs: [2206 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1389 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1389 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1389 [Constant] outputs: [2207 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1390 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1390 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1390 [Constant] outputs: [2208 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1391 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1391 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1391 [Constant] outputs: [2209 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1392 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1392 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1392 [Constant] outputs: [2210 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1393 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2155 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2208 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2209 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2207 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2210 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1393 [Slice] inputs: [2155 -> (1, 6, 16, 16)], [2208 -> (1)], [2209 -> (1)], [2207 -> (1)], [2210 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1393 for ONNX node: Slice_1393 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2211 for ONNX tensor: 2211 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1393 [Slice] outputs: [2211 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1394 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1394 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1394 [Constant] outputs: [2212 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1395 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2211 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2212 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1395 [Mul] inputs: [2211 -> (1, 1, 16, 16)], [2212 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2212 for ONNX initializer: 2212 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1395 for ONNX node: Mul_1395 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2213 for ONNX tensor: 2213 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1395 [Mul] outputs: [2213 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1396 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1396 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1396 [Constant] outputs: [2214 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1397 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1397 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1397 [Constant] outputs: [2215 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1398 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1398 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1398 [Constant] outputs: [2216 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1399 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1399 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1399 [Constant] outputs: [2217 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1400 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2154 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2215 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2216 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2214 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2217 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1400 [Slice] inputs: [2154 -> (1, 6, 16, 16)], [2215 -> (1)], [2216 -> (1)], [2214 -> (1)], [2217 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1400 for ONNX node: Slice_1400 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2218 for ONNX tensor: 2218 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1400 [Slice] outputs: [2218 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1401 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1401 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1401 [Constant] outputs: [2219 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1402 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2218 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2219 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1402 [Add] inputs: [2218 -> (1, 1, 16, 16)], [2219 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2219 for ONNX initializer: 2219 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1402 for ONNX node: Add_1402 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2220 for ONNX tensor: 2220 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1402 [Add] outputs: [2220 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1403 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1403 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1403 [Constant] outputs: [2221 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1404 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1404 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1404 [Constant] outputs: [2222 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1405 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1405 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1405 [Constant] outputs: [2223 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1406 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1406 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1406 [Constant] outputs: [2224 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1407 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2154 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2222 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2223 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2221 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2224 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1407 [Slice] inputs: [2154 -> (1, 6, 16, 16)], [2222 -> (1)], [2223 -> (1)], [2221 -> (1)], [2224 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1407 for ONNX node: Slice_1407 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2225 for ONNX tensor: 2225 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1407 [Slice] outputs: [2225 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1408 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1408 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1408 [Constant] outputs: [2226 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1409 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2225 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2226 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1409 [Add] inputs: [2225 -> (1, 1, 16, 16)], [2226 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2226 for ONNX initializer: 2226 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1409 for ONNX node: Add_1409 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2227 for ONNX tensor: 2227 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1409 [Add] outputs: [2227 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1410 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1410 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1410 [Constant] outputs: [2228 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1411 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1411 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1411 [Constant] outputs: [2229 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1412 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1412 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1412 [Constant] outputs: [2230 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1413 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1413 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1413 [Constant] outputs: [2231 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1414 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2155 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2229 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2230 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2228 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2231 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1414 [Slice] inputs: [2155 -> (1, 6, 16, 16)], [2229 -> (1)], [2230 -> (1)], [2228 -> (1)], [2231 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1414 for ONNX node: Slice_1414 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2232 for ONNX tensor: 2232 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1414 [Slice] outputs: [2232 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1415 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1415 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1415 [Constant] outputs: [2233 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1416 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2232 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2233 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1416 [Mul] inputs: [2232 -> (1, 1, 16, 16)], [2233 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2233 for ONNX initializer: 2233 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1416 for ONNX node: Mul_1416 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2234 for ONNX tensor: 2234 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1416 [Mul] outputs: [2234 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1417 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1417 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1417 [Constant] outputs: [2235 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1418 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1418 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1418 [Constant] outputs: [2236 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1419 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1419 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1419 [Constant] outputs: [2237 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1420 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1420 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1420 [Constant] outputs: [2238 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1421 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2155 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2236 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2237 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2235 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2238 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1421 [Slice] inputs: [2155 -> (1, 6, 16, 16)], [2236 -> (1)], [2237 -> (1)], [2235 -> (1)], [2238 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1421 for ONNX node: Slice_1421 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2239 for ONNX tensor: 2239 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1421 [Slice] outputs: [2239 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1422 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1422 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1422 [Constant] outputs: [2240 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1423 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2239 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2240 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1423 [Mul] inputs: [2239 -> (1, 1, 16, 16)], [2240 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2240 for ONNX initializer: 2240 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1423 for ONNX node: Mul_1423 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2241 for ONNX tensor: 2241 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1423 [Mul] outputs: [2241 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1424 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2164 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2192 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2220 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1424 [Concat] inputs: [2164 -> (1, 1, 16, 16)], [2192 -> (1, 1, 16, 16)], [2220 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1424 for ONNX node: Concat_1424 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2242 for ONNX tensor: 2242 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1424 [Concat] outputs: [2242 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1425 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2171 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2199 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2227 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1425 [Concat] inputs: [2171 -> (1, 1, 16, 16)], [2199 -> (1, 1, 16, 16)], [2227 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1425 for ONNX node: Concat_1425 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2243 for ONNX tensor: 2243 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1425 [Concat] outputs: [2243 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1426 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2178 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2206 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2234 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1426 [Concat] inputs: [2178 -> (1, 1, 16, 16)], [2206 -> (1, 1, 16, 16)], [2234 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1426 for ONNX node: Concat_1426 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2244 for ONNX tensor: 2244 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1426 [Concat] outputs: [2244 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1427 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2185 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2213 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2241 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1427 [Concat] inputs: [2185 -> (1, 1, 16, 16)], [2213 -> (1, 1, 16, 16)], [2241 -> (1, 1, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1427 for ONNX node: Concat_1427 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2245 for ONNX tensor: 2245 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1427 [Concat] outputs: [2245 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1428 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2242 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2244 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1428 [Concat] inputs: [2242 -> (1, 3, 16, 16)], [2244 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1428 for ONNX node: Concat_1428 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2246 for ONNX tensor: 2246 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1428 [Concat] outputs: [2246 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1429 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2243 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2245 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1429 [Concat] inputs: [2243 -> (1, 3, 16, 16)], [2245 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1429 for ONNX node: Concat_1429 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2247 for ONNX tensor: 2247 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1429 [Concat] outputs: [2247 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1430 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1430 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1430 for ONNX node: Shape_1430 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2248 for ONNX tensor: 2248 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1430 [Shape] outputs: [2248 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1431 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1431 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1431 [Constant] outputs: [2249 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1432 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2248 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2249 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1432 [Gather] inputs: [2248 -> (4)], [2249 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2249 for ONNX initializer: 2249 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1432 for ONNX node: Gather_1432 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2250 for ONNX tensor: 2250 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1432 [Gather] outputs: [2250 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Cast_1433 [Cast] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2250 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Cast_1433 [Cast] inputs: [2250 -> ()], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Cast_1433 for ONNX node: Cast_1433 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2251 for ONNX tensor: 2251 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Cast_1433 [Cast] outputs: [2251 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Div_1434 [Div] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2246 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2251 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Div_1434 [Div] inputs: [2246 -> (1, 6, 16, 16)], [2251 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Div_1434 for ONNX node: Div_1434 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2252 for ONNX tensor: 2252 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Div_1434 [Div] outputs: [2252 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1435 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1435 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1435 for ONNX node: Shape_1435 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2253 for ONNX tensor: 2253 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1435 [Shape] outputs: [2253 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1436 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1436 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1436 [Constant] outputs: [2254 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1437 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2253 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2254 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1437 [Gather] inputs: [2253 -> (4)], [2254 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2254 for ONNX initializer: 2254 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1437 for ONNX node: Gather_1437 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2255 for ONNX tensor: 2255 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1437 [Gather] outputs: [2255 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Cast_1438 [Cast] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2255 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Cast_1438 [Cast] inputs: [2255 -> ()], [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Cast_1438 for ONNX node: Cast_1438 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2256 for ONNX tensor: 2256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Cast_1438 [Cast] outputs: [2256 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Div_1439 [Div] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2247 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2256 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Div_1439 [Div] inputs: [2247 -> (1, 6, 16, 16)], [2256 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Div_1439 for ONNX node: Div_1439 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2257 for ONNX tensor: 2257 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Div_1439 [Div] outputs: [2257 -> (1, 6, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1440 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1440 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1440 [Constant] outputs: [2258 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1441 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1441 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1441 [Constant] outputs: [2259 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1442 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1442 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1442 [Constant] outputs: [2260 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1443 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1443 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1443 [Constant] outputs: [2261 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1444 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2252 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2259 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2260 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2258 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2261 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1444 [Slice] inputs: [2252 -> (1, 6, 16, 16)], [2259 -> (1)], [2260 -> (1)], [2258 -> (1)], [2261 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1444 for ONNX node: Slice_1444 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2262 for ONNX tensor: 2262 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1444 [Slice] outputs: [2262 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1445 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1445 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1445 for ONNX node: Shape_1445 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2263 for ONNX tensor: 2263 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1445 [Shape] outputs: [2263 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1446 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1446 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1446 [Constant] outputs: [2264 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1447 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2263 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2264 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1447 [Gather] inputs: [2263 -> (4)], [2264 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2264 for ONNX initializer: 2264 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1447 for ONNX node: Gather_1447 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2265 for ONNX tensor: 2265 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1447 [Gather] outputs: [2265 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1448 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1448 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1448 for ONNX node: Shape_1448 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2266 for ONNX tensor: 2266 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1448 [Shape] outputs: [2266 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1449 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1449 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1449 [Constant] outputs: [2267 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1450 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2266 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2267 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1450 [Gather] inputs: [2266 -> (4)], [2267 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2267 for ONNX initializer: 2267 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1450 for ONNX node: Gather_1450 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2268 for ONNX tensor: 2268 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1450 [Gather] outputs: [2268 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1451 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1451 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1451 [Constant] outputs: [2269 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1452 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2268 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2269 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1452 [Mul] inputs: [2268 -> ()], [2269 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2269 for ONNX initializer: 2269 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1452 for ONNX node: Mul_1452 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2270 for ONNX tensor: 2270 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1452 [Mul] outputs: [2270 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1453 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1453 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1453 for ONNX node: Shape_1453 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2271 for ONNX tensor: 2271 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1453 [Shape] outputs: [2271 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1454 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1454 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1454 [Constant] outputs: [2272 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1455 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2271 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2272 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1455 [Gather] inputs: [2271 -> (4)], [2272 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2272 for ONNX initializer: 2272 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1455 for ONNX node: Gather_1455 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2273 for ONNX tensor: 2273 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1455 [Gather] outputs: [2273 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1456 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2270 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2273 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1456 [Mul] inputs: [2270 -> ()], [2273 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1456 for ONNX node: Mul_1456 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2274 for ONNX tensor: 2274 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1456 [Mul] outputs: [2274 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1457 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2265 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1457 [Unsqueeze] inputs: [2265 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1457 for ONNX node: Unsqueeze_1457 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2276 for ONNX tensor: 2276 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1457 [Unsqueeze] outputs: [2276 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1458 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2274 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1458 [Unsqueeze] inputs: [2274 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1458 for ONNX node: Unsqueeze_1458 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2277 for ONNX tensor: 2277 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1458 [Unsqueeze] outputs: [2277 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1459 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2276 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2277 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2752 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1459 [Concat] inputs: [2276 -> (1)], [2277 -> (1)], [2752 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2752 for ONNX initializer: 2752 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1459 for ONNX node: Concat_1459 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2279 for ONNX tensor: 2279 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1459 [Concat] outputs: [2279 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1460 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2262 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2279 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1460 [Reshape] inputs: [2262 -> (1, 3, 16, 16)], [2279 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1460 for ONNX node: Reshape_1460 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2280 for ONNX tensor: 2280 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1460 [Reshape] outputs: [2280 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1461 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1461 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1461 [Constant] outputs: [2281 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1462 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1462 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1462 [Constant] outputs: [2282 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1463 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1463 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1463 [Constant] outputs: [2283 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1464 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1464 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1464 [Constant] outputs: [2284 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1465 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2257 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2282 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2283 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2281 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2284 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1465 [Slice] inputs: [2257 -> (1, 6, 16, 16)], [2282 -> (1)], [2283 -> (1)], [2281 -> (1)], [2284 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1465 for ONNX node: Slice_1465 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2285 for ONNX tensor: 2285 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1465 [Slice] outputs: [2285 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1466 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1466 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1466 for ONNX node: Shape_1466 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2286 for ONNX tensor: 2286 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1466 [Shape] outputs: [2286 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1467 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1467 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1467 [Constant] outputs: [2287 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1468 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2286 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2287 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1468 [Gather] inputs: [2286 -> (4)], [2287 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2287 for ONNX initializer: 2287 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1468 for ONNX node: Gather_1468 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2288 for ONNX tensor: 2288 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1468 [Gather] outputs: [2288 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1469 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1469 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1469 for ONNX node: Shape_1469 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2289 for ONNX tensor: 2289 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1469 [Shape] outputs: [2289 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1470 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1470 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1470 [Constant] outputs: [2290 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1471 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2289 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2290 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1471 [Gather] inputs: [2289 -> (4)], [2290 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2290 for ONNX initializer: 2290 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1471 for ONNX node: Gather_1471 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2291 for ONNX tensor: 2291 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1471 [Gather] outputs: [2291 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1472 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1472 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1472 [Constant] outputs: [2292 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1473 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2291 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2292 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1473 [Mul] inputs: [2291 -> ()], [2292 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2292 for ONNX initializer: 2292 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1473 for ONNX node: Mul_1473 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2293 for ONNX tensor: 2293 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1473 [Mul] outputs: [2293 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1474 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1474 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1474 for ONNX node: Shape_1474 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2294 for ONNX tensor: 2294 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1474 [Shape] outputs: [2294 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1475 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1475 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1475 [Constant] outputs: [2295 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1476 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2294 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2295 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1476 [Gather] inputs: [2294 -> (4)], [2295 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2295 for ONNX initializer: 2295 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1476 for ONNX node: Gather_1476 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2296 for ONNX tensor: 2296 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1476 [Gather] outputs: [2296 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1477 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2293 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2296 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1477 [Mul] inputs: [2293 -> ()], [2296 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1477 for ONNX node: Mul_1477 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2297 for ONNX tensor: 2297 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1477 [Mul] outputs: [2297 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1478 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2288 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1478 [Unsqueeze] inputs: [2288 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1478 for ONNX node: Unsqueeze_1478 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2299 for ONNX tensor: 2299 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1478 [Unsqueeze] outputs: [2299 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1479 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2297 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1479 [Unsqueeze] inputs: [2297 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1479 for ONNX node: Unsqueeze_1479 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2300 for ONNX tensor: 2300 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1479 [Unsqueeze] outputs: [2300 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1480 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2299 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2300 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2753 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1480 [Concat] inputs: [2299 -> (1)], [2300 -> (1)], [2753 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2753 for ONNX initializer: 2753 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1480 for ONNX node: Concat_1480 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2302 for ONNX tensor: 2302 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1480 [Concat] outputs: [2302 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1481 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2285 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2302 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1481 [Reshape] inputs: [2285 -> (1, 3, 16, 16)], [2302 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1481 for ONNX node: Reshape_1481 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2303 for ONNX tensor: 2303 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1481 [Reshape] outputs: [2303 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1482 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1482 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1482 [Constant] outputs: [2304 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1483 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1483 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1483 [Constant] outputs: [2305 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1484 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1484 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [06/13/2021-16:48:57] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1484 [Constant] outputs: [2306 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1485 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1485 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1485 [Constant] outputs: [2307 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1486 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2252 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2305 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2306 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2304 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2307 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1486 [Slice] inputs: [2252 -> (1, 6, 16, 16)], [2305 -> (1)], [2306 -> (1)], [2304 -> (1)], [2307 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1486 for ONNX node: Slice_1486 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2308 for ONNX tensor: 2308 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1486 [Slice] outputs: [2308 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1487 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1487 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1487 for ONNX node: Shape_1487 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2309 for ONNX tensor: 2309 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1487 [Shape] outputs: [2309 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1488 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1488 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1488 [Constant] outputs: [2310 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1489 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2309 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2310 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1489 [Gather] inputs: [2309 -> (4)], [2310 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2310 for ONNX initializer: 2310 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1489 for ONNX node: Gather_1489 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2311 for ONNX tensor: 2311 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1489 [Gather] outputs: [2311 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1490 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1490 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1490 for ONNX node: Shape_1490 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2312 for ONNX tensor: 2312 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1490 [Shape] outputs: [2312 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1491 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1491 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1491 [Constant] outputs: [2313 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1492 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2312 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2313 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1492 [Gather] inputs: [2312 -> (4)], [2313 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2313 for ONNX initializer: 2313 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1492 for ONNX node: Gather_1492 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2314 for ONNX tensor: 2314 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1492 [Gather] outputs: [2314 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1493 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1493 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1493 [Constant] outputs: [2315 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1494 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2314 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2315 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1494 [Mul] inputs: [2314 -> ()], [2315 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2315 for ONNX initializer: 2315 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1494 for ONNX node: Mul_1494 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2316 for ONNX tensor: 2316 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1494 [Mul] outputs: [2316 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1495 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1495 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1495 for ONNX node: Shape_1495 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2317 for ONNX tensor: 2317 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1495 [Shape] outputs: [2317 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1496 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1496 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1496 [Constant] outputs: [2318 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1497 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2317 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2318 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1497 [Gather] inputs: [2317 -> (4)], [2318 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2318 for ONNX initializer: 2318 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1497 for ONNX node: Gather_1497 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2319 for ONNX tensor: 2319 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1497 [Gather] outputs: [2319 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1498 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2316 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2319 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1498 [Mul] inputs: [2316 -> ()], [2319 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1498 for ONNX node: Mul_1498 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2320 for ONNX tensor: 2320 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1498 [Mul] outputs: [2320 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1499 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2311 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1499 [Unsqueeze] inputs: [2311 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1499 for ONNX node: Unsqueeze_1499 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2322 for ONNX tensor: 2322 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1499 [Unsqueeze] outputs: [2322 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1500 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2320 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1500 [Unsqueeze] inputs: [2320 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1500 for ONNX node: Unsqueeze_1500 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2323 for ONNX tensor: 2323 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1500 [Unsqueeze] outputs: [2323 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1501 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2322 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2323 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2754 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1501 [Concat] inputs: [2322 -> (1)], [2323 -> (1)], [2754 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2754 for ONNX initializer: 2754 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1501 for ONNX node: Concat_1501 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2325 for ONNX tensor: 2325 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1501 [Concat] outputs: [2325 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1502 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2308 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2325 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1502 [Reshape] inputs: [2308 -> (1, 3, 16, 16)], [2325 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1502 for ONNX node: Reshape_1502 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2326 for ONNX tensor: 2326 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1502 [Reshape] outputs: [2326 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1503 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1503 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1503 [Constant] outputs: [2327 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1504 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1504 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1504 [Constant] outputs: [2328 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1505 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1505 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [06/13/2021-16:48:57] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1505 [Constant] outputs: [2329 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1506 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1506 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1506 [Constant] outputs: [2330 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_1507 [Slice] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2257 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2328 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2329 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2327 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2330 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Slice_1507 [Slice] inputs: [2257 -> (1, 6, 16, 16)], [2328 -> (1)], [2329 -> (1)], [2327 -> (1)], [2330 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_1507 for ONNX node: Slice_1507 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2331 for ONNX tensor: 2331 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Slice_1507 [Slice] outputs: [2331 -> (1, 3, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1508 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1508 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1508 for ONNX node: Shape_1508 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2332 for ONNX tensor: 2332 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1508 [Shape] outputs: [2332 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1509 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1509 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1509 [Constant] outputs: [2333 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1510 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2332 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2333 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1510 [Gather] inputs: [2332 -> (4)], [2333 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2333 for ONNX initializer: 2333 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1510 for ONNX node: Gather_1510 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2334 for ONNX tensor: 2334 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1510 [Gather] outputs: [2334 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1511 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1511 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1511 for ONNX node: Shape_1511 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2335 for ONNX tensor: 2335 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1511 [Shape] outputs: [2335 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1512 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1512 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1512 [Constant] outputs: [2336 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1513 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2335 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2336 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1513 [Gather] inputs: [2335 -> (4)], [2336 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2336 for ONNX initializer: 2336 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1513 for ONNX node: Gather_1513 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2337 for ONNX tensor: 2337 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1513 [Gather] outputs: [2337 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1514 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1514 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1514 [Constant] outputs: [2338 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1515 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2337 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2338 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1515 [Mul] inputs: [2337 -> ()], [2338 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2338 for ONNX initializer: 2338 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1515 for ONNX node: Mul_1515 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2339 for ONNX tensor: 2339 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1515 [Mul] outputs: [2339 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1516 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1516 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1516 for ONNX node: Shape_1516 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2340 for ONNX tensor: 2340 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1516 [Shape] outputs: [2340 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1517 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1517 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1517 [Constant] outputs: [2341 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1518 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2340 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2341 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1518 [Gather] inputs: [2340 -> (4)], [2341 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2341 for ONNX initializer: 2341 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1518 for ONNX node: Gather_1518 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2342 for ONNX tensor: 2342 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1518 [Gather] outputs: [2342 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1519 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2339 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2342 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1519 [Mul] inputs: [2339 -> ()], [2342 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1519 for ONNX node: Mul_1519 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2343 for ONNX tensor: 2343 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1519 [Mul] outputs: [2343 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1520 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2334 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1520 [Unsqueeze] inputs: [2334 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1520 for ONNX node: Unsqueeze_1520 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2345 for ONNX tensor: 2345 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1520 [Unsqueeze] outputs: [2345 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1521 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2343 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1521 [Unsqueeze] inputs: [2343 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1521 for ONNX node: Unsqueeze_1521 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2346 for ONNX tensor: 2346 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1521 [Unsqueeze] outputs: [2346 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1522 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2345 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2346 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2755 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1522 [Concat] inputs: [2345 -> (1)], [2346 -> (1)], [2755 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2755 for ONNX initializer: 2755 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1522 for ONNX node: Concat_1522 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2348 for ONNX tensor: 2348 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1522 [Concat] outputs: [2348 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1523 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2331 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2348 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1523 [Reshape] inputs: [2331 -> (1, 3, 16, 16)], [2348 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1523 for ONNX node: Reshape_1523 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2349 for ONNX tensor: 2349 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1523 [Reshape] outputs: [2349 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1524 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1524 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1524 [Constant] outputs: [2350 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1525 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2326 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2350 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1525 [Mul] inputs: [2326 -> (-1, -1, -1)], [2350 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2350 for ONNX initializer: 2350 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1525 for ONNX node: Mul_1525 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2351 for ONNX tensor: 2351 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1525 [Mul] outputs: [2351 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_1526 [Sub] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2280 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2351 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sub_1526 [Sub] inputs: [2280 -> (-1, -1, -1)], [2351 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sub_1526 for ONNX node: Sub_1526 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2352 for ONNX tensor: 2352 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sub_1526 [Sub] outputs: [2352 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1527 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1527 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1527 [Constant] outputs: [2353 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1528 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2349 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2353 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1528 [Mul] inputs: [2349 -> (-1, -1, -1)], [2353 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2353 for ONNX initializer: 2353 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1528 for ONNX node: Mul_1528 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2354 for ONNX tensor: 2354 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1528 [Mul] outputs: [2354 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Sub_1529 [Sub] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2303 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2354 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Sub_1529 [Sub] inputs: [2303 -> (-1, -1, -1)], [2354 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Sub_1529 for ONNX node: Sub_1529 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2355 for ONNX tensor: 2355 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Sub_1529 [Sub] outputs: [2355 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1530 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2352 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2326 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1530 [Add] inputs: [2352 -> (-1, -1, -1)], [2326 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1530 for ONNX node: Add_1530 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2356 for ONNX tensor: 2356 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1530 [Add] outputs: [2356 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_1531 [Add] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2355 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2349 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Add_1531 [Add] inputs: [2355 -> (-1, -1, -1)], [2349 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_1531 for ONNX node: Add_1531 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2357 for ONNX tensor: 2357 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Add_1531 [Add] outputs: [2357 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1532 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2352 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2355 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2356 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2357 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1532 [Concat] inputs: [2352 -> (-1, -1, -1)], [2355 -> (-1, -1, -1)], [2356 -> (-1, -1, -1)], [2357 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1532 for ONNX node: Concat_1532 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2358 for ONNX tensor: 2358 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1532 [Concat] outputs: [2358 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1533 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1533 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1533 for ONNX node: Shape_1533 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2359 for ONNX tensor: 2359 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1533 [Shape] outputs: [2359 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1534 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1534 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1534 [Constant] outputs: [2360 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1535 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2359 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2360 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1535 [Gather] inputs: [2359 -> (4)], [2360 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2360 for ONNX initializer: 2360 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1535 for ONNX node: Gather_1535 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2361 for ONNX tensor: 2361 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1535 [Gather] outputs: [2361 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1536 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1536 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1536 for ONNX node: Shape_1536 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2362 for ONNX tensor: 2362 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1536 [Shape] outputs: [2362 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1537 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1537 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1537 [Constant] outputs: [2363 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1538 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2362 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2363 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1538 [Gather] inputs: [2362 -> (4)], [2363 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2363 for ONNX initializer: 2363 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1538 for ONNX node: Gather_1538 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2364 for ONNX tensor: 2364 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1538 [Gather] outputs: [2364 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1539 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1539 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1539 [Constant] outputs: [2365 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1540 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2364 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2365 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1540 [Mul] inputs: [2364 -> ()], [2365 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2365 for ONNX initializer: 2365 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1540 for ONNX node: Mul_1540 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2366 for ONNX tensor: 2366 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1540 [Mul] outputs: [2366 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1541 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1541 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1541 for ONNX node: Shape_1541 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2367 for ONNX tensor: 2367 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1541 [Shape] outputs: [2367 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1542 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1542 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1542 [Constant] outputs: [2368 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1543 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2367 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2368 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1543 [Gather] inputs: [2367 -> (4)], [2368 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2368 for ONNX initializer: 2368 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1543 for ONNX node: Gather_1543 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2369 for ONNX tensor: 2369 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1543 [Gather] outputs: [2369 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1544 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2366 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2369 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1544 [Mul] inputs: [2366 -> ()], [2369 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1544 for ONNX node: Mul_1544 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2370 for ONNX tensor: 2370 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1544 [Mul] outputs: [2370 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1545 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2361 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1545 [Unsqueeze] inputs: [2361 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1545 for ONNX node: Unsqueeze_1545 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2373 for ONNX tensor: 2373 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1545 [Unsqueeze] outputs: [2373 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1546 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2370 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1546 [Unsqueeze] inputs: [2370 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1546 for ONNX node: Unsqueeze_1546 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2374 for ONNX tensor: 2374 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1546 [Unsqueeze] outputs: [2374 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1547 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2373 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2374 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2756 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2757 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1547 [Concat] inputs: [2373 -> (1)], [2374 -> (1)], [2756 -> (1)], [2757 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2756 for ONNX initializer: 2756 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2757 for ONNX initializer: 2757 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1547 for ONNX node: Concat_1547 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2377 for ONNX tensor: 2377 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1547 [Concat] outputs: [2377 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1548 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2358 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2377 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1548 [Reshape] inputs: [2358 -> (-1, -1, -1)], [2377 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1548 for ONNX node: Reshape_1548 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2378 for ONNX tensor: 2378 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1548 [Reshape] outputs: [2378 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1549 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1549 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1549 for ONNX node: Shape_1549 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2379 for ONNX tensor: 2379 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1549 [Shape] outputs: [2379 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1550 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1550 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1550 [Constant] outputs: [2380 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1551 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2379 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2380 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1551 [Gather] inputs: [2379 -> (4)], [2380 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2380 for ONNX initializer: 2380 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1551 for ONNX node: Gather_1551 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2381 for ONNX tensor: 2381 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1551 [Gather] outputs: [2381 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1552 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1552 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1552 for ONNX node: Shape_1552 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2382 for ONNX tensor: 2382 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1552 [Shape] outputs: [2382 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1553 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1553 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1553 [Constant] outputs: [2383 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1554 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2382 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2383 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1554 [Gather] inputs: [2382 -> (4)], [2383 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2383 for ONNX initializer: 2383 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1554 for ONNX node: Gather_1554 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2384 for ONNX tensor: 2384 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1554 [Gather] outputs: [2384 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1555 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1555 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1555 [Constant] outputs: [2385 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1556 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2384 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2385 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1556 [Mul] inputs: [2384 -> ()], [2385 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2385 for ONNX initializer: 2385 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1556 for ONNX node: Mul_1556 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2386 for ONNX tensor: 2386 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1556 [Mul] outputs: [2386 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_1557 [Shape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2032 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Shape_1557 [Shape] inputs: [2032 -> (1, 255, 16, 16)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_1557 for ONNX node: Shape_1557 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2387 for ONNX tensor: 2387 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Shape_1557 [Shape] outputs: [2387 -> (4)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_1558 [Constant] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Constant_1558 [Constant] inputs: [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Constant_1558 [Constant] outputs: [2388 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_1559 [Gather] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2387 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2388 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Gather_1559 [Gather] inputs: [2387 -> (4)], [2388 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2388 for ONNX initializer: 2388 [06/13/2021-16:48:57] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_1559 for ONNX node: Gather_1559 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2389 for ONNX tensor: 2389 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Gather_1559 [Gather] outputs: [2389 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1560 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2386 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2389 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1560 [Mul] inputs: [2386 -> ()], [2389 -> ()], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1560 for ONNX node: Mul_1560 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2390 for ONNX tensor: 2390 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1560 [Mul] outputs: [2390 -> ()], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1561 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2381 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1561 [Unsqueeze] inputs: [2381 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1561 for ONNX node: Unsqueeze_1561 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2392 for ONNX tensor: 2392 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1561 [Unsqueeze] outputs: [2392 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_1562 [Unsqueeze] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2390 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_1562 [Unsqueeze] inputs: [2390 -> ()], [06/13/2021-16:48:57] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_1562 for ONNX node: Unsqueeze_1562 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2393 for ONNX tensor: 2393 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_1562 [Unsqueeze] outputs: [2393 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1563 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2392 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2393 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2758 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1563 [Concat] inputs: [2392 -> (1)], [2393 -> (1)], [2758 -> (1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 2758 for ONNX initializer: 2758 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1563 for ONNX node: Concat_1563 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2395 for ONNX tensor: 2395 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1563 [Concat] outputs: [2395 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_1564 [Reshape] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2156 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2395 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Reshape_1564 [Reshape] inputs: [2156 -> (-1, -1)], [2395 -> (3)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_1564 for ONNX node: Reshape_1564 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2396 for ONNX tensor: 2396 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Reshape_1564 [Reshape] outputs: [2396 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Mul_1565 [Mul] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2157 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2396 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Mul_1565 [Mul] inputs: [2157 -> (-1, -1, -1)], [2396 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Mul_1565 for ONNX node: Mul_1565 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 2397 for ONNX tensor: 2397 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Mul_1565 [Mul] outputs: [2397 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1566 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1602 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1990 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2378 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1566 [Concat] inputs: [1602 -> (-1, -1, -1, -1)], [1990 -> (-1, -1, -1, -1)], [2378 -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1566 for ONNX node: Concat_1566 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: boxes_0 for ONNX tensor: boxes [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1566 [Concat] outputs: [boxes -> (-1, -1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_1567 [Concat] [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 1621 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2009 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:119: Searching for input: 2397 [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:125: Concat_1567 [Concat] inputs: [1621 -> (-1, -1, -1)], [2009 -> (-1, -1, -1)], [2397 -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_1567 for ONNX node: Concat_1567 [06/13/2021-16:48:57] [V] [TRT] ImporterContext.hpp:120: Registering tensor: confs_1 for ONNX tensor: confs [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:179: Concat_1567 [Concat] outputs: [confs -> (-1, -1, -1)], [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:510: Marking boxes_0 as output: boxes [06/13/2021-16:48:57] [V] [TRT] ModelImporter.cpp:510: Marking confs_1 as output: confs [06/13/2021-16:48:57] [06/13/2021-16:48:57] [06/13/2021-16:48:57] [06/13/2021-16:48:57] ----- Parsing of ONNX model ../../../data/mnist/yolov4_1_3_512_512_static.onnx is Done ---- [06/13/2021-16:48:57] [I] MY constructNetwork() getMaxWorkspaceSize() = 524288000 [06/13/2021-16:48:57] [I] ***************** constructNetwork() END ********************* [06/13/2021-16:48:57] [V] [TRT] Applying generic optimizations to the graph for inference. [06/13/2021-16:48:57] [V] [TRT] Original: 726 layers [06/13/2021-16:48:57] [V] [TRT] After dead-layer removal: 726 layers [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1375 with (Unnamed Layer* 599) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1377 with (Unnamed Layer* 602) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1401 with (Unnamed Layer* 615) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1408 with (Unnamed Layer* 619) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1429 with (Unnamed Layer* 629) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1436 with (Unnamed Layer* 633) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1457 with (Unnamed Layer* 643) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1464 with (Unnamed Layer* 647) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1574 with (Unnamed Layer* 740) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1577 with (Unnamed Layer* 744) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1763 with (Unnamed Layer* 870) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1765 with (Unnamed Layer* 873) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1789 with (Unnamed Layer* 886) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1796 with (Unnamed Layer* 890) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1817 with (Unnamed Layer* 900) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1824 with (Unnamed Layer* 904) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1845 with (Unnamed Layer* 914) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1852 with (Unnamed Layer* 918) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1962 with (Unnamed Layer* 1011) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1965 with (Unnamed Layer* 1015) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2151 with (Unnamed Layer* 1141) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2153 with (Unnamed Layer* 1144) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2177 with (Unnamed Layer* 1157) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2184 with (Unnamed Layer* 1161) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2205 with (Unnamed Layer* 1171) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2212 with (Unnamed Layer* 1175) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2233 with (Unnamed Layer* 1185) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2240 with (Unnamed Layer* 1189) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2350 with (Unnamed Layer* 1282) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2353 with (Unnamed Layer* 1286) [Shuffle] [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing Reshape_592 with Transpose_593 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing Reshape_953 with Transpose_954 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing Reshape_1314 with Transpose_1315 [06/13/2021-16:48:57] [V] [TRT] After Myelin optimization: 693 layers [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1375 + (Unnamed Layer* 599) [Shuffle] with Mul_612 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1401 + (Unnamed Layer* 615) [Shuffle] with Mul_638 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1408 + (Unnamed Layer* 619) [Shuffle] with Mul_645 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1429 + (Unnamed Layer* 629) [Shuffle] with Mul_666 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1436 + (Unnamed Layer* 633) [Shuffle] with Mul_673 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1457 + (Unnamed Layer* 643) [Shuffle] with Mul_694 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1464 + (Unnamed Layer* 647) [Shuffle] with Mul_701 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1387 with Add_624 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1394 with Add_631 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1415 with Add_652 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1422 with Add_659 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1443 with Add_680 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1450 with Add_687 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1763 + (Unnamed Layer* 870) [Shuffle] with Mul_973 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1789 + (Unnamed Layer* 886) [Shuffle] with Mul_999 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1796 + (Unnamed Layer* 890) [Shuffle] with Mul_1006 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1817 + (Unnamed Layer* 900) [Shuffle] with Mul_1027 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1824 + (Unnamed Layer* 904) [Shuffle] with Mul_1034 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1845 + (Unnamed Layer* 914) [Shuffle] with Mul_1055 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1852 + (Unnamed Layer* 918) [Shuffle] with Mul_1062 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1775 with Add_985 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1782 with Add_992 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1803 with Add_1013 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1810 with Add_1020 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1831 with Add_1041 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 1838 with Add_1048 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2151 + (Unnamed Layer* 1141) [Shuffle] with Mul_1334 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2177 + (Unnamed Layer* 1157) [Shuffle] with Mul_1360 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2184 + (Unnamed Layer* 1161) [Shuffle] with Mul_1367 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2205 + (Unnamed Layer* 1171) [Shuffle] with Mul_1388 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2212 + (Unnamed Layer* 1175) [Shuffle] with Mul_1395 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2233 + (Unnamed Layer* 1185) [Shuffle] with Mul_1416 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2240 + (Unnamed Layer* 1189) [Shuffle] with Mul_1423 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2163 with Add_1346 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2170 with Add_1353 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2191 with Add_1374 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2198 with Add_1381 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2219 with Add_1402 [06/13/2021-16:48:57] [V] [TRT] BinaryFusion: Fusing 2226 with Add_1409 [06/13/2021-16:48:57] [V] [TRT] After scale fusion: 654 layers [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_1 with Tanh_2 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_1, Tanh_2) with Mul_3 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_5 with Tanh_6 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_5, Tanh_6) with Mul_7 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_13 with Tanh_14 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_13, Tanh_14) with Mul_15 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_17 with Tanh_18 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_17, Tanh_18) with Mul_19 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_21 with Tanh_22 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_21, Tanh_22) with Mul_23 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_21, Tanh_22), Mul_23) with Add_24 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_9 with Tanh_10 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_9, Tanh_10) with Mul_11 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_26 with Tanh_27 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_26, Tanh_27) with Mul_28 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_31 with Tanh_32 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_31, Tanh_32) with Mul_33 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_35 with Tanh_36 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_35, Tanh_36) with Mul_37 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_43 with Tanh_44 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_43, Tanh_44) with Mul_45 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_47 with Tanh_48 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_47, Tanh_48) with Mul_49 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_51 with Tanh_52 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_51, Tanh_52) with Mul_53 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_51, Tanh_52), Mul_53) with Add_54 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_56 with Tanh_57 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_56, Tanh_57) with Mul_58 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_60 with Tanh_61 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_60, Tanh_61) with Mul_62 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_60, Tanh_61), Mul_62) with Add_63 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_39 with Tanh_40 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_39, Tanh_40) with Mul_41 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_65 with Tanh_66 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_65, Tanh_66) with Mul_67 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_70 with Tanh_71 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_70, Tanh_71) with Mul_72 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_74 with Tanh_75 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_74, Tanh_75) with Mul_76 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_82 with Tanh_83 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_82, Tanh_83) with Mul_84 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_86 with Tanh_87 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_86, Tanh_87) with Mul_88 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_90 with Tanh_91 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_90, Tanh_91) with Mul_92 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_90, Tanh_91), Mul_92) with Add_93 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_95 with Tanh_96 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_95, Tanh_96) with Mul_97 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_99 with Tanh_100 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_99, Tanh_100) with Mul_101 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_99, Tanh_100), Mul_101) with Add_102 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_104 with Tanh_105 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_104, Tanh_105) with Mul_106 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_108 with Tanh_109 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_108, Tanh_109) with Mul_110 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_108, Tanh_109), Mul_110) with Add_111 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_113 with Tanh_114 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_113, Tanh_114) with Mul_115 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_117 with Tanh_118 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_117, Tanh_118) with Mul_119 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_117, Tanh_118), Mul_119) with Add_120 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_122 with Tanh_123 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_122, Tanh_123) with Mul_124 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_126 with Tanh_127 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_126, Tanh_127) with Mul_128 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_126, Tanh_127), Mul_128) with Add_129 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_131 with Tanh_132 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_131, Tanh_132) with Mul_133 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_135 with Tanh_136 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_135, Tanh_136) with Mul_137 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_135, Tanh_136), Mul_137) with Add_138 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_140 with Tanh_141 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_140, Tanh_141) with Mul_142 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_144 with Tanh_145 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_144, Tanh_145) with Mul_146 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_144, Tanh_145), Mul_146) with Add_147 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_149 with Tanh_150 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_149, Tanh_150) with Mul_151 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_153 with Tanh_154 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_153, Tanh_154) with Mul_155 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_153, Tanh_154), Mul_155) with Add_156 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_78 with Tanh_79 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_78, Tanh_79) with Mul_80 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_158 with Tanh_159 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_158, Tanh_159) with Mul_160 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_163 with Tanh_164 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_163, Tanh_164) with Mul_165 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_167 with Tanh_168 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_167, Tanh_168) with Mul_169 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_175 with Tanh_176 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_175, Tanh_176) with Mul_177 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_179 with Tanh_180 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_179, Tanh_180) with Mul_181 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_183 with Tanh_184 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_183, Tanh_184) with Mul_185 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_183, Tanh_184), Mul_185) with Add_186 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_188 with Tanh_189 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_188, Tanh_189) with Mul_190 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_192 with Tanh_193 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_192, Tanh_193) with Mul_194 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_192, Tanh_193), Mul_194) with Add_195 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_197 with Tanh_198 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_197, Tanh_198) with Mul_199 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_201 with Tanh_202 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_201, Tanh_202) with Mul_203 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_201, Tanh_202), Mul_203) with Add_204 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_206 with Tanh_207 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_206, Tanh_207) with Mul_208 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_210 with Tanh_211 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_210, Tanh_211) with Mul_212 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_210, Tanh_211), Mul_212) with Add_213 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_215 with Tanh_216 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_215, Tanh_216) with Mul_217 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_219 with Tanh_220 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_219, Tanh_220) with Mul_221 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_219, Tanh_220), Mul_221) with Add_222 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_224 with Tanh_225 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_224, Tanh_225) with Mul_226 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_228 with Tanh_229 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_228, Tanh_229) with Mul_230 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_228, Tanh_229), Mul_230) with Add_231 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_233 with Tanh_234 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_233, Tanh_234) with Mul_235 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_237 with Tanh_238 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_237, Tanh_238) with Mul_239 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_237, Tanh_238), Mul_239) with Add_240 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_242 with Tanh_243 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_242, Tanh_243) with Mul_244 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_246 with Tanh_247 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_246, Tanh_247) with Mul_248 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_246, Tanh_247), Mul_248) with Add_249 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_171 with Tanh_172 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_171, Tanh_172) with Mul_173 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_251 with Tanh_252 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_251, Tanh_252) with Mul_253 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_256 with Tanh_257 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_256, Tanh_257) with Mul_258 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_260 with Tanh_261 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_260, Tanh_261) with Mul_262 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_268 with Tanh_269 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_268, Tanh_269) with Mul_270 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_272 with Tanh_273 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_272, Tanh_273) with Mul_274 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_276 with Tanh_277 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_276, Tanh_277) with Mul_278 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_276, Tanh_277), Mul_278) with Add_279 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_281 with Tanh_282 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_281, Tanh_282) with Mul_283 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_285 with Tanh_286 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_285, Tanh_286) with Mul_287 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_285, Tanh_286), Mul_287) with Add_288 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_290 with Tanh_291 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_290, Tanh_291) with Mul_292 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_294 with Tanh_295 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_294, Tanh_295) with Mul_296 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_294, Tanh_295), Mul_296) with Add_297 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_299 with Tanh_300 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_299, Tanh_300) with Mul_301 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_303 with Tanh_304 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_303, Tanh_304) with Mul_305 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(PWN(Softplus_303, Tanh_304), Mul_305) with Add_306 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_264 with Tanh_265 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_264, Tanh_265) with Mul_266 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_308 with Tanh_309 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_308, Tanh_309) with Mul_310 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Softplus_313 with Tanh_314 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Softplus_313, Tanh_314) with Mul_315 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Sigmoid_610 with 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Sigmoid_617 with Mul_843 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Sigmoid_610, 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612) with Sub_614 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing 1377 + (Unnamed Layer* 602) [Shuffle] with PWN(PWN(Sigmoid_610, 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612), Sub_614) [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing 1574 + (Unnamed Layer* 740) [Shuffle] with Mul_803 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing 1577 + (Unnamed Layer* 744) [Shuffle] with Mul_806 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(1574 + (Unnamed Layer* 740) [Shuffle], Mul_803) with Sub_804 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(1577 + (Unnamed Layer* 744) [Shuffle], Mul_806) with Sub_807 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Sigmoid_971 with 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Sigmoid_978 with Mul_1204 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Sigmoid_971, 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973) with Sub_975 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing 1765 + (Unnamed Layer* 873) [Shuffle] with PWN(PWN(Sigmoid_971, 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973), Sub_975) [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing 1962 + (Unnamed Layer* 1011) [Shuffle] with Mul_1164 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing 1965 + (Unnamed Layer* 1015) [Shuffle] with Mul_1167 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(1962 + (Unnamed Layer* 1011) [Shuffle], Mul_1164) with Sub_1165 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(1965 + (Unnamed Layer* 1015) [Shuffle], Mul_1167) with Sub_1168 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Sigmoid_1332 with 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing Sigmoid_1339 with Mul_1565 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(Sigmoid_1332, 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334) with Sub_1336 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing 2153 + (Unnamed Layer* 1144) [Shuffle] with PWN(PWN(Sigmoid_1332, 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334), Sub_1336) [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing 2350 + (Unnamed Layer* 1282) [Shuffle] with Mul_1525 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing 2353 + (Unnamed Layer* 1286) [Shuffle] with Mul_1528 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(2350 + (Unnamed Layer* 1282) [Shuffle], Mul_1525) with Sub_1526 [06/13/2021-16:48:57] [V] [TRT] BinaryFusionBase: Fusing PWN(2353 + (Unnamed Layer* 1286) [Shuffle], Mul_1528) with Sub_1529 [06/13/2021-16:48:58] [V] [TRT] After vertical fusions: 463 layers [06/13/2021-16:48:58] [V] [TRT] After dupe layer removal: 463 layers [06/13/2021-16:48:58] [V] [TRT] After final dead-layer removal: 463 layers [06/13/2021-16:48:58] [V] [TRT] Merging layers: Conv_8 || Conv_12 [06/13/2021-16:48:58] [V] [TRT] Merging layers: Conv_38 || Conv_42 [06/13/2021-16:48:58] [V] [TRT] Merging layers: Conv_77 || Conv_81 [06/13/2021-16:48:58] [V] [TRT] Merging layers: Conv_170 || Conv_174 [06/13/2021-16:48:58] [V] [TRT] Merging layers: Conv_263 || Conv_267 [06/13/2021-16:48:58] [V] [TRT] After tensor merging: 458 layers [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_503 with copy from 1256 to 1261 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_508 with copy from 1256 to 1266 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_513 with copy from 1256 to 1271 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_518 with copy from 1256 to 1276 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_523 with copy from 1256 to 1281 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_528 with copy from 1256 to 1286 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_533 with copy from 1256 to 1291 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_538 with copy from 1256 to 1296 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_543 with copy from 1256 to 1301 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_548 with copy from 1256 to 1306 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_553 with copy from 1256 to 1311 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_558 with copy from 1256 to 1316 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_636 with copy from 1379 to 1400 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_643 with copy from 1379 to 1407 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_664 with copy from 1379 to 1428 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_671 with copy from 1379 to 1435 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_692 with copy from 1379 to 1456 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_699 with copy from 1379 to 1463 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_622 with copy from 1378 to 1386 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_629 with copy from 1378 to 1393 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_650 with copy from 1378 to 1414 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_657 with copy from 1378 to 1421 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_678 with copy from 1378 to 1442 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_685 with copy from 1378 to 1449 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_722 with copy from 1476 to 1486 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_764 with copy from 1476 to 1532 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_743 with copy from 1481 to 1509 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_785 with copy from 1481 to 1555 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_864 with copy from 1644 to 1649 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_869 with copy from 1644 to 1654 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_874 with copy from 1644 to 1659 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_879 with copy from 1644 to 1664 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_884 with copy from 1644 to 1669 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_889 with copy from 1644 to 1674 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_894 with copy from 1644 to 1679 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_899 with copy from 1644 to 1684 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_904 with copy from 1644 to 1689 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_909 with copy from 1644 to 1694 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_914 with copy from 1644 to 1699 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_919 with copy from 1644 to 1704 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_997 with copy from 1767 to 1788 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1004 with copy from 1767 to 1795 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1025 with copy from 1767 to 1816 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1032 with copy from 1767 to 1823 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1053 with copy from 1767 to 1844 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1060 with copy from 1767 to 1851 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_983 with copy from 1766 to 1774 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_990 with copy from 1766 to 1781 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1011 with copy from 1766 to 1802 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1018 with copy from 1766 to 1809 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1039 with copy from 1766 to 1830 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1046 with copy from 1766 to 1837 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1083 with copy from 1864 to 1874 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1125 with copy from 1864 to 1920 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1104 with copy from 1869 to 1897 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1146 with copy from 1869 to 1943 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1225 with copy from 2032 to 2037 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1230 with copy from 2032 to 2042 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1235 with copy from 2032 to 2047 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1240 with copy from 2032 to 2052 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1245 with copy from 2032 to 2057 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1250 with copy from 2032 to 2062 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1255 with copy from 2032 to 2067 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1260 with copy from 2032 to 2072 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1265 with copy from 2032 to 2077 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1270 with copy from 2032 to 2082 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1275 with copy from 2032 to 2087 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1280 with copy from 2032 to 2092 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1358 with copy from 2155 to 2176 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1365 with copy from 2155 to 2183 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1386 with copy from 2155 to 2204 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1393 with copy from 2155 to 2211 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1414 with copy from 2155 to 2232 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1421 with copy from 2155 to 2239 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1344 with copy from 2154 to 2162 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1351 with copy from 2154 to 2169 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1372 with copy from 2154 to 2190 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1379 with copy from 2154 to 2197 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1400 with copy from 2154 to 2218 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1407 with copy from 2154 to 2225 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1444 with copy from 2252 to 2262 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1486 with copy from 2252 to 2308 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1465 with copy from 2257 to 2285 [06/13/2021-16:48:58] [V] [TRT] Replacing slice Slice_1507 with copy from 2257 to 2331 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_29 [06/13/2021-16:48:58] [V] [TRT] Retargeting 684 to 685 [06/13/2021-16:48:58] [V] [TRT] Retargeting 663 to 685 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_68 [06/13/2021-16:48:58] [V] [TRT] Retargeting 732 to 733 [06/13/2021-16:48:58] [V] [TRT] Retargeting 700 to 733 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_161 [06/13/2021-16:48:58] [V] [TRT] Retargeting 846 to 847 [06/13/2021-16:48:58] [V] [TRT] Retargeting 748 to 847 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_254 [06/13/2021-16:48:58] [V] [TRT] Retargeting 960 to 961 [06/13/2021-16:48:58] [V] [TRT] Retargeting 862 to 961 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_311 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1030 to 1031 [06/13/2021-16:48:58] [V] [TRT] Retargeting 976 to 1031 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_325 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1048 to 1049 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1047 to 1049 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1046 to 1049 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1045 to 1049 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_403 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1139 to 1140 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1136 to 1140 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_485 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1236 to 1237 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1233 to 1237 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_846 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1624 to 1625 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1155 to 1625 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_559 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1261 to 1317 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1281 to 1317 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1301 to 1317 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_560 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1266 to 1318 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1286 to 1318 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1306 to 1318 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_561 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1271 to 1319 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1291 to 1319 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1311 to 1319 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_578 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1276 to 1336 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1296 to 1336 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1316 to 1336 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_704 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1402 to 1468 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1430 to 1468 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1458 to 1468 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_705 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1409 to 1469 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1437 to 1469 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1465 to 1469 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_702 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1388 to 1466 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1416 to 1466 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1444 to 1466 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_703 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1395 to 1467 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1423 to 1467 [06/13/2021-16:48:58] [V] [TRT] Retargeting 1451 to 1467 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_706 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1466 to 1470 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1468 to 1470 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_707 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1467 to 1471 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1469 to 1471 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_810 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1576 to 1582 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1579 to 1582 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1580 to 1582 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1581 to 1582 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1207 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2012 to 2013 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1058 to 2013 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_920 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1649 to 1705 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1669 to 1705 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1689 to 1705 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_921 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1654 to 1706 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1674 to 1706 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1694 to 1706 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_922 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1659 to 1707 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1679 to 1707 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1699 to 1707 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_939 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1664 to 1724 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1684 to 1724 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1704 to 1724 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1065 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1790 to 1856 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1818 to 1856 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1846 to 1856 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1066 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1797 to 1857 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1825 to 1857 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1853 to 1857 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1063 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1776 to 1854 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1804 to 1854 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1832 to 1854 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1064 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1783 to 1855 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1811 to 1855 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1839 to 1855 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1067 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1854 to 1858 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1856 to 1858 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1068 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1855 to 1859 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1857 to 1859 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1171 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1964 to 1970 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1967 to 1970 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1968 to 1970 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1969 to 1970 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1281 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2037 to 2093 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2057 to 2093 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2077 to 2093 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1282 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2042 to 2094 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2062 to 2094 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2082 to 2094 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1283 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2047 to 2095 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2067 to 2095 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2087 to 2095 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1300 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2052 to 2112 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2072 to 2112 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2092 to 2112 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1567 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1621 to confs [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2009 to confs [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2397 to confs [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1426 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2178 to 2244 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2206 to 2244 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2234 to 2244 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1427 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2185 to 2245 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2213 to 2245 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2241 to 2245 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1424 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2164 to 2242 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2192 to 2242 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2220 to 2242 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1425 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2171 to 2243 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2199 to 2243 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2227 to 2243 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1428 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2242 to 2246 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2244 to 2246 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1429 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2243 to 2247 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2245 to 2247 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1532 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2352 to 2358 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2355 to 2358 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2356 to 2358 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2357 to 2358 [06/13/2021-16:48:58] [V] [TRT] Eliminating concatenation Concat_1566 [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1602 to boxes [06/13/2021-16:48:58] [V] [TRT] Generating copy for 1990 to boxes [06/13/2021-16:48:58] [V] [TRT] Generating copy for 2378 to boxes [06/13/2021-16:48:58] [V] [TRT] After concat removal: 494 layers [06/13/2021-16:48:58] [V] [TRT] Graph construction and optimization completed in 0.349503 seconds. [06/13/2021-16:48:58] [V] [TRT] Constructing optimization profile number 0 [1/1]. [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1649 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1654 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1659 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1664 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1669 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1674 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1679 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1684 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1689 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1694 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1699 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1704 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1856 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1857 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1854 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 1855 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2037 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2042 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2047 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2052 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2057 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2062 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2067 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2072 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2077 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2082 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2087 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2092 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2244 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2245 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2242 [06/13/2021-16:48:58] [V] [TRT] Using kFLOAT for region surrounded by copy operations: 2243 [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: -> Int32() *************** [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: -> Int32() *************** [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: -> Int32() *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:48:58] [V] [TRT] Tactic: 1002 time 0.293888 [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 0.050176 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0.050176 [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144,786432) -> Float(1,512,262144,8388608) *************** [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [06/13/2021-16:48:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Conv_0 (CaskConvolution) [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: 1062367460111450758 time 0.275456 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: 1754984623894446479 time 0.316416 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: 3611739942397549984 time 0.924672 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: 3827454225649558724 time 0.429056 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: 4337000649858996379 time 0.46592 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: 4501471010995462441 time 0.871424 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: 5137655947464784826 time 0.45056 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: 5288347012147084929 time 0.913408 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: 5921334924264294896 time 0.437248 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: 6645123197870846056 time 0.459776 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: 7144526460361122478 time 0.31744 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: 7852627285308570038 time 0.458752 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: -9137461792520977713 time 0.881664 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: -8776506421218919509 time 0.418816 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: -8262349710178828730 time 0.922624 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: -8133971918129952780 time 0.461824 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: -6092040395344634144 time 0.279552 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: -4787320710726427159 time 0.316416 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: -3456450830548107839 time 0.264192 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: -2318106587342035239 time 0.441344 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: -1343271414618805657 time 0.418816 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: -1218658103698133241 time 0.459776 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Tactic: -836875257600482091 time 0.453632 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Tactic: -410470605513481746 time 0.862208 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 0.264192 [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Conv_0 (CudaConvolution) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 0.780288 [06/13/2021-16:48:58] [V] [TRT] Tactic: 1 time 0.636928 [06/13/2021-16:48:58] [V] [TRT] Tactic: 2 time 0.949248 [06/13/2021-16:48:58] [V] [TRT] Tactic: 5 time 10.0649 [06/13/2021-16:48:58] [V] [TRT] Tactic: 6 time 0.784224 [06/13/2021-16:48:58] [V] [TRT] Tactic: 56 time 0.779264 [06/13/2021-16:48:58] [V] [TRT] Tactic: 57 time 0.637952 [06/13/2021-16:48:58] [V] [TRT] Tactic: 58 time 0.953344 [06/13/2021-16:48:58] [V] [TRT] Tactic: 61 time 10.0803 [06/13/2021-16:48:58] [V] [TRT] Tactic: 62 time 0.781312 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 1 Time: 0.636928 [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [06/13/2021-16:48:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Conv_0 (CublasConvolution) [06/13/2021-16:48:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3456450830548107839 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Float(3,1536,1,786432) -> Float(32,16384,1,8388608) *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [06/13/2021-16:48:58] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Conv_0 (CaskConvolution) [06/13/2021-16:48:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Conv_0 (CudaConvolution) [06/13/2021-16:48:58] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [06/13/2021-16:48:58] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Conv_0 (CublasConvolution) [06/13/2021-16:48:58] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Int32() -> Float() *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_1438 (Reformat) [06/13/2021-16:48:58] [V] [TRT] Reformat has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_1438 (Cast) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:48:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Cast Tactic: 0 [06/13/2021-16:48:58] [V] [TRT] [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Int32() -> Float() *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_1433 (Reformat) [06/13/2021-16:48:58] [V] [TRT] Reformat has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_1433 (Cast) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:48:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Cast Tactic: 0 [06/13/2021-16:48:58] [V] [TRT] [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Int32() -> Float() *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_1077 (Reformat) [06/13/2021-16:48:58] [V] [TRT] Reformat has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_1077 (Cast) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:48:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Cast Tactic: 0 [06/13/2021-16:48:58] [V] [TRT] [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Int32() -> Float() *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_1072 (Reformat) [06/13/2021-16:48:58] [V] [TRT] Reformat has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_1072 (Cast) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:48:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Cast Tactic: 0 [06/13/2021-16:48:58] [V] [TRT] [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Int32() -> Float() *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_716 (Reformat) [06/13/2021-16:48:58] [V] [TRT] Reformat has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_716 (Cast) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:48:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Cast Tactic: 0 [06/13/2021-16:48:58] [V] [TRT] [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Int32() -> Float() *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_711 (Reformat) [06/13/2021-16:48:58] [V] [TRT] Reformat has no valid tactics for this config, skipping [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: Cast_711 (Cast) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:48:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Cast Tactic: 0 [06/13/2021-16:48:58] [V] [TRT] [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Float() -> Float(1,1,1,1) *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 1207) [Shuffle] (Shuffle) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:48:58] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Float() -> Float(1,1,1,1) *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 1201) [Shuffle] (Shuffle) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Float() -> Float(1,1,1,1) *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 936) [Shuffle] (Shuffle) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Float() -> Float(1,1,1,1) *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 930) [Shuffle] (Shuffle) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Float() -> Float(1,1,1,1) *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 665) [Shuffle] (Shuffle) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Float() -> Float(1,1,1,1) *************** [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 659) [Shuffle] (Shuffle) [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:48:58] [V] [TRT] Tactic: 1002 time 0.462848 [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 1.17555 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.462848 [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:48:58] [V] [TRT] Tactic: 1002 time 0.735232 [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 2.36339 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.735232 [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:48:58] [V] [TRT] Tactic: 1002 time 0.45568 [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 1.43462 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.45568 [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:48:58] [V] [TRT] Tactic: 1002 time 0.736256 [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 3.84102 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 1002 Time: 0.736256 [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:48:58] [V] [TRT] Tactic: 1002 time 1.49197 [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 1.43565 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 1.43565 [06/13/2021-16:48:58] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:48:58] [V] [TRT] Tactic: 1002 time 0.699392 [06/13/2021-16:48:58] [V] [TRT] Tactic: 0 time 0.53248 [06/13/2021-16:48:58] [V] [TRT] Fastest Tactic: 0 Time: 0.53248 [06/13/2021-16:48:58] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144,8388608) -> Float(1,512,262144,8388608) *************** [06/13/2021-16:49:00] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_1, Tanh_2), Mul_3) (PointWise) [06/13/2021-16:49:00] [V] [TRT] Tactic: 128 time 1.20832 [06/13/2021-16:49:00] [V] [TRT] Tactic: 256 time 1.20934 [06/13/2021-16:49:00] [V] [TRT] Tactic: 512 time 1.20832 [06/13/2021-16:49:00] [V] [TRT] Tactic: -32 time 1.28102 [06/13/2021-16:49:00] [V] [TRT] Tactic: -64 time 1.22982 [06/13/2021-16:49:00] [V] [TRT] Tactic: -128 time 1.23085 [06/13/2021-16:49:00] [V] [TRT] Fastest Tactic: 128 Time: 1.20832 [06/13/2021-16:49:00] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_1, Tanh_2), Mul_3) (PointWiseV2) [06/13/2021-16:49:00] [V] [TRT] Tactic: 0 time 0.36352 [06/13/2021-16:49:00] [V] [TRT] Tactic: 1 time 0.333824 [06/13/2021-16:49:00] [V] [TRT] Tactic: 2 time 0.333824 [06/13/2021-16:49:00] [V] [TRT] Tactic: 3 time 0.329728 [06/13/2021-16:49:00] [V] [TRT] Tactic: 4 time 0.3328 [06/13/2021-16:49:00] [V] [TRT] Tactic: 5 time 0.336896 [06/13/2021-16:49:00] [V] [TRT] Tactic: 6 time 0.3328 [06/13/2021-16:49:00] [V] [TRT] Tactic: 7 time 0.329728 [06/13/2021-16:49:00] [V] [TRT] Tactic: 8 time 0.330752 [06/13/2021-16:49:00] [V] [TRT] Tactic: 9 time 0.3328 [06/13/2021-16:49:00] [V] [TRT] Tactic: 28 time 0.355328 [06/13/2021-16:49:00] [V] [TRT] Fastest Tactic: 3 Time: 0.329728 [06/13/2021-16:49:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [06/13/2021-16:49:00] [V] [TRT] [06/13/2021-16:49:00] [V] [TRT] *************** Autotuning format combination: Float(32,16384,1,8388608) -> Float(32,16384,1,8388608) *************** [06/13/2021-16:49:00] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_1, Tanh_2), Mul_3) (PointWise) [06/13/2021-16:49:00] [V] [TRT] Tactic: 128 time 1.20832 [06/13/2021-16:49:00] [V] [TRT] Tactic: 256 time 1.21037 [06/13/2021-16:49:00] [V] [TRT] Tactic: 512 time 1.20832 [06/13/2021-16:49:00] [V] [TRT] Tactic: -32 time 1.28102 [06/13/2021-16:49:00] [V] [TRT] Tactic: -64 time 1.2288 [06/13/2021-16:49:00] [V] [TRT] Tactic: -128 time 1.23187 [06/13/2021-16:49:00] [V] [TRT] Fastest Tactic: 128 Time: 1.20832 [06/13/2021-16:49:00] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_1, Tanh_2), Mul_3) (PointWiseV2) [06/13/2021-16:49:00] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:00] [V] [TRT] [06/13/2021-16:49:00] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144:32,262144) -> Float(1,512,262144:32,262144) *************** [06/13/2021-16:49:01] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_1, Tanh_2), Mul_3) (PointWise) [06/13/2021-16:49:01] [V] [TRT] Tactic: 128 time 1.20832 [06/13/2021-16:49:01] [V] [TRT] Tactic: 256 time 1.20934 [06/13/2021-16:49:01] [V] [TRT] Tactic: 512 time 1.20832 [06/13/2021-16:49:01] [V] [TRT] Tactic: -32 time 1.28 [06/13/2021-16:49:01] [V] [TRT] Tactic: -64 time 1.2288 [06/13/2021-16:49:01] [V] [TRT] Tactic: -128 time 1.23085 [06/13/2021-16:49:01] [V] [TRT] Fastest Tactic: 128 Time: 1.20832 [06/13/2021-16:49:01] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_1, Tanh_2), Mul_3) (PointWiseV2) [06/13/2021-16:49:01] [V] [TRT] Tactic: 24 time 0.381952 [06/13/2021-16:49:01] [V] [TRT] Tactic: 25 time 0.382976 [06/13/2021-16:49:01] [V] [TRT] Tactic: 26 time 0.386048 [06/13/2021-16:49:01] [V] [TRT] Tactic: 27 time 0.392192 [06/13/2021-16:49:01] [V] [TRT] Tactic: 31 time 0.380928 [06/13/2021-16:49:01] [V] [TRT] Fastest Tactic: 31 Time: 0.380928 [06/13/2021-16:49:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [06/13/2021-16:49:01] [V] [TRT] [06/13/2021-16:49:01] [V] [TRT] *************** Autotuning format combination: Float(1,512,262144,8388608) -> Float(1,256,65536,4194304) *************** [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:01] [V] [TRT] --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [06/13/2021-16:49:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:01] [V] [TRT] --------------- Timing Runner: Conv_4 (CaskConvolution) [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Tactic: 1062367460111450758 time 0.627712 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Tactic: 1754984623894446479 time 0.760832 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Tactic: 3611739942397549984 time 1.00147 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Tactic: 4337000649858996379 time 0.541696 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Tactic: 4501471010995462441 time 0.991232 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Tactic: 5137655947464784826 time 0.520192 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Tactic: 5288347012147084929 time 0.986112 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Tactic: 6645123197870846056 time 0.536576 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Tactic: 7144526460361122478 time 0.745472 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Tactic: -9137461792520977713 time 1.00352 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Tactic: -8262349710178828730 time 0.997376 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Tactic: -8133971918129952780 time 0.545792 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Tactic: -6092040395344634144 time 0.586752 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Tactic: -4787320710726427159 time 0.700416 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Tactic: -3456450830548107839 time 0.546816 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Tactic: -1218658103698133241 time 0.54272 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:01] [V] [TRT] Tactic: -836875257600482091 time 0.529408 [06/13/2021-16:49:01] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:01] [V] [TRT] Tactic: -410470605513481746 time 0.868352 [06/13/2021-16:49:01] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.520192 [06/13/2021-16:49:01] [V] [TRT] --------------- Timing Runner: Conv_4 (CudaConvolution) [06/13/2021-16:49:01] [V] [TRT] Tactic: 0 time 1.13971 [06/13/2021-16:49:01] [V] [TRT] Tactic: 1 time 1.03014 [06/13/2021-16:49:01] [V] [TRT] Tactic: 2 time 1.60666 [06/13/2021-16:49:01] [V] [TRT] Tactic: 5 time 18.7453 [06/13/2021-16:49:01] [V] [TRT] Tactic: 56 time 1.13869 [06/13/2021-16:49:01] [V] [TRT] Tactic: 57 time 1.03014 [06/13/2021-16:49:01] [V] [TRT] Tactic: 58 time 1.6087 [06/13/2021-16:49:02] [V] [TRT] Tactic: 61 time 18.7371 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1 Time: 1.03014 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [06/13/2021-16:49:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_4 (CublasConvolution) [06/13/2021-16:49:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] *************** Autotuning format combination: Float(32,16384,1,8388608) -> Float(64,16384,1,4194304) *************** [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [06/13/2021-16:49:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_4 (CaskConvolution) [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: -9153228964338181824 time 0.539648 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: -7394439838318485025 time 0.46592 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.46592 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_4 (CudaConvolution) [06/13/2021-16:49:02] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [06/13/2021-16:49:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_4 (CublasConvolution) [06/13/2021-16:49:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.200704 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 0.270336 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.200704 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.31744 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 1.20934 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.31744 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.196608 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 0.722944 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.196608 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.370688 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 2.36032 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.370688 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.690176 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 0.723968 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.690176 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.360448 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 0.237568 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 0 Time: 0.237568 [06/13/2021-16:49:02] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,4194304) *************** [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_5, Tanh_6), Mul_7) (PointWise) [06/13/2021-16:49:02] [V] [TRT] Tactic: 128 time 0.536576 [06/13/2021-16:49:02] [V] [TRT] Tactic: 256 time 0.5376 [06/13/2021-16:49:02] [V] [TRT] Tactic: 512 time 0.5376 [06/13/2021-16:49:02] [V] [TRT] Tactic: -32 time 0.580608 [06/13/2021-16:49:02] [V] [TRT] Tactic: -64 time 0.550912 [06/13/2021-16:49:02] [V] [TRT] Tactic: -128 time 0.549888 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 128 Time: 0.536576 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_5, Tanh_6), Mul_7) (PointWiseV2) [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 0.173056 [06/13/2021-16:49:02] [V] [TRT] Tactic: 1 time 0.169984 [06/13/2021-16:49:02] [V] [TRT] Tactic: 2 time 0.16896 [06/13/2021-16:49:02] [V] [TRT] Tactic: 3 time 0.166912 [06/13/2021-16:49:02] [V] [TRT] Tactic: 4 time 0.167936 [06/13/2021-16:49:02] [V] [TRT] Tactic: 5 time 0.167936 [06/13/2021-16:49:02] [V] [TRT] Tactic: 6 time 0.16896 [06/13/2021-16:49:02] [V] [TRT] Tactic: 7 time 0.167936 [06/13/2021-16:49:02] [V] [TRT] Tactic: 8 time 0.166912 [06/13/2021-16:49:02] [V] [TRT] Tactic: 9 time 0.167936 [06/13/2021-16:49:02] [V] [TRT] Tactic: 28 time 0.172032 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 3 Time: 0.166912 [06/13/2021-16:49:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [06/13/2021-16:49:02] [V] [TRT] [06/13/2021-16:49:02] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304) -> Float(64,16384,1,4194304) *************** [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_5, Tanh_6), Mul_7) (PointWise) [06/13/2021-16:49:02] [V] [TRT] Tactic: 128 time 0.536576 [06/13/2021-16:49:02] [V] [TRT] Tactic: 256 time 0.5376 [06/13/2021-16:49:02] [V] [TRT] Tactic: 512 time 0.5376 [06/13/2021-16:49:02] [V] [TRT] Tactic: -32 time 0.580608 [06/13/2021-16:49:02] [V] [TRT] Tactic: -64 time 0.550912 [06/13/2021-16:49:02] [V] [TRT] Tactic: -128 time 0.548864 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 128 Time: 0.536576 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_5, Tanh_6), Mul_7) (PointWiseV2) [06/13/2021-16:49:02] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:02] [V] [TRT] [06/13/2021-16:49:02] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536:32,131072) -> Float(1,256,65536:32,131072) *************** [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_5, Tanh_6), Mul_7) (PointWise) [06/13/2021-16:49:02] [V] [TRT] Tactic: 128 time 0.536576 [06/13/2021-16:49:02] [V] [TRT] Tactic: 256 time 0.5376 [06/13/2021-16:49:02] [V] [TRT] Tactic: 512 time 0.5376 [06/13/2021-16:49:02] [V] [TRT] Tactic: -32 time 0.579584 [06/13/2021-16:49:02] [V] [TRT] Tactic: -64 time 0.551936 [06/13/2021-16:49:02] [V] [TRT] Tactic: -128 time 0.548864 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 128 Time: 0.536576 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_5, Tanh_6), Mul_7) (PointWiseV2) [06/13/2021-16:49:02] [V] [TRT] Tactic: 24 time 0.191488 [06/13/2021-16:49:02] [V] [TRT] Tactic: 25 time 0.193536 [06/13/2021-16:49:02] [V] [TRT] Tactic: 26 time 0.19456 [06/13/2021-16:49:02] [V] [TRT] Tactic: 27 time 0.197632 [06/13/2021-16:49:02] [V] [TRT] Tactic: 31 time 0.191648 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 24 Time: 0.191488 [06/13/2021-16:49:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:02] [V] [TRT] [06/13/2021-16:49:02] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,8388608) *************** [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_8 || Conv_12 (FusedConvActConvolution) [06/13/2021-16:49:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_8 || Conv_12 (CaskConvolution) [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: 1062367460111450758 time 0.520192 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Tactic: 1698681053543049347 time 0.509952 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: 4501471010995462441 time 0.318464 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: 5137655947464784826 time 0.361472 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Tactic: 5288347012147084929 time 0.3328 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: 5326823351883942011 time 0.314368 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Tactic: 5500448035057547314 time 0.391168 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: 6645123197870846056 time 0.361472 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Tactic: 7144526460361122478 time 0.533504 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Tactic: -8262349710178828730 time 0.334848 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: -6576203419454146580 time 0.516096 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Tactic: -4787320710726427159 time 0.530432 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: -3456450830548107839 time 0.521216 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Tactic: -1218658103698133241 time 0.39936 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Tactic: -836875257600482091 time 0.395264 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: -410470605513481746 time 0.318464 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Tactic: -377491875521947884 time 0.319488 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: -37215280111360163 time 0.3584 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.314368 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_8 || Conv_12 (CudaConvolution) [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 0.873472 [06/13/2021-16:49:02] [V] [TRT] Tactic: 1 time 0.69632 [06/13/2021-16:49:02] [V] [TRT] Tactic: 2 time 1.02605 [06/13/2021-16:49:02] [V] [TRT] Tactic: 4 skipped. Scratch requested: 4362371072, available: 524288000 [06/13/2021-16:49:02] [V] [TRT] Tactic: 5 time 1.52166 [06/13/2021-16:49:02] [V] [TRT] Tactic: 56 time 0.872448 [06/13/2021-16:49:02] [V] [TRT] Tactic: 57 time 0.703488 [06/13/2021-16:49:02] [V] [TRT] Tactic: 58 time 1.02605 [06/13/2021-16:49:02] [V] [TRT] Tactic: 60 skipped. Scratch requested: 4362371072, available: 524288000 [06/13/2021-16:49:02] [V] [TRT] Tactic: 61 time 1.52666 [06/13/2021-16:49:02] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output. [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1 Time: 0.69632 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_8 || Conv_12 (CudaDepthwiseConvolution) [06/13/2021-16:49:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_8 || Conv_12 (CublasConvolution) [06/13/2021-16:49:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:02] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304) -> Float(128,32768,1,8388608) *************** [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_8 || Conv_12 (FusedConvActConvolution) [06/13/2021-16:49:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_8 || Conv_12 (CaskConvolution) [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: 3886731678879822788 time 0.350208 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: 6629944304117643200 time 0.467968 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: -9153228964338181824 time 0.473088 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Tactic: -7394439838318485025 time 0.357376 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.350208 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_8 || Conv_12 (CudaConvolution) [06/13/2021-16:49:02] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_8 || Conv_12 (CudaDepthwiseConvolution) [06/13/2021-16:49:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: Conv_8 || Conv_12 (CublasConvolution) [06/13/2021-16:49:02] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.402432 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 0.991232 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.402432 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.62464 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 2.37978 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.62464 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.39936 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 2.07258 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.39936 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.763904 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 5.28077 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.763904 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.19456 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 0.252928 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.19456 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.318464 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 1.21139 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.318464 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.193536 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 1.02912 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.193536 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.388096 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 2.63066 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.388096 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.697344 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 0.723968 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.697344 [06/13/2021-16:49:02] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:02] [V] [TRT] Tactic: 1002 time 0.361472 [06/13/2021-16:49:02] [V] [TRT] Tactic: 0 time 0.237568 [06/13/2021-16:49:02] [V] [TRT] Fastest Tactic: 0 Time: 0.237568 [06/13/2021-16:49:02] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,8388608) -> Float(1,256,65536,4194304) *************** [06/13/2021-16:49:04] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_13, Tanh_14), Mul_15) (PointWise) [06/13/2021-16:49:04] [V] [TRT] Tactic: 128 time 0.608256 [06/13/2021-16:49:04] [V] [TRT] Tactic: 256 time 0.608256 [06/13/2021-16:49:04] [V] [TRT] Tactic: 512 time 0.607232 [06/13/2021-16:49:04] [V] [TRT] Tactic: -32 time 0.581632 [06/13/2021-16:49:04] [V] [TRT] Tactic: -64 time 0.556032 [06/13/2021-16:49:04] [V] [TRT] Tactic: -128 time 0.557056 [06/13/2021-16:49:04] [V] [TRT] Fastest Tactic: -64 Time: 0.556032 [06/13/2021-16:49:04] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_13, Tanh_14), Mul_15) (PointWiseV2) [06/13/2021-16:49:04] [V] [TRT] Tactic: 0 time 0.198656 [06/13/2021-16:49:04] [V] [TRT] Tactic: 1 time 0.16896 [06/13/2021-16:49:04] [V] [TRT] Tactic: 2 time 0.16896 [06/13/2021-16:49:04] [V] [TRT] Tactic: 3 time 0.16896 [06/13/2021-16:49:04] [V] [TRT] Tactic: 4 time 0.167936 [06/13/2021-16:49:04] [V] [TRT] Tactic: 5 time 0.16896 [06/13/2021-16:49:04] [V] [TRT] Tactic: 6 time 0.16896 [06/13/2021-16:49:04] [V] [TRT] Tactic: 7 time 0.166912 [06/13/2021-16:49:04] [V] [TRT] Tactic: 8 time 0.166912 [06/13/2021-16:49:04] [V] [TRT] Tactic: 9 time 0.166912 [06/13/2021-16:49:04] [V] [TRT] Tactic: 28 time 0.190464 [06/13/2021-16:49:04] [V] [TRT] Fastest Tactic: 7 Time: 0.166912 [06/13/2021-16:49:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [06/13/2021-16:49:04] [V] [TRT] [06/13/2021-16:49:04] [V] [TRT] *************** Autotuning format combination: Float(128,32768,1,8388608) -> Float(64,16384,1,4194304) *************** [06/13/2021-16:49:04] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_13, Tanh_14), Mul_15) (PointWise) [06/13/2021-16:49:04] [V] [TRT] Tactic: 128 time 0.608256 [06/13/2021-16:49:04] [V] [TRT] Tactic: 256 time 0.608256 [06/13/2021-16:49:04] [V] [TRT] Tactic: 512 time 0.607232 [06/13/2021-16:49:04] [V] [TRT] Tactic: -32 time 0.618496 [06/13/2021-16:49:04] [V] [TRT] Tactic: -64 time 0.654336 [06/13/2021-16:49:04] [V] [TRT] Tactic: -128 time 0.654336 [06/13/2021-16:49:04] [V] [TRT] Fastest Tactic: 512 Time: 0.607232 [06/13/2021-16:49:04] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_13, Tanh_14), Mul_15) (PointWiseV2) [06/13/2021-16:49:04] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 512 [06/13/2021-16:49:04] [V] [TRT] [06/13/2021-16:49:04] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536:32,262144) -> Float(1,256,65536:32,131072) *************** [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_13, Tanh_14), Mul_15) (PointWise) [06/13/2021-16:49:05] [V] [TRT] Tactic: 128 time 0.74752 [06/13/2021-16:49:05] [V] [TRT] Tactic: 256 time 0.74752 [06/13/2021-16:49:05] [V] [TRT] Tactic: 512 time 0.745472 [06/13/2021-16:49:05] [V] [TRT] Tactic: -32 time 0.710464 [06/13/2021-16:49:05] [V] [TRT] Tactic: -64 time 0.681984 [06/13/2021-16:49:05] [V] [TRT] Tactic: -128 time 0.684032 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: -64 Time: 0.681984 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_13, Tanh_14), Mul_15) (PointWiseV2) [06/13/2021-16:49:05] [V] [TRT] Tactic: 24 time 0.196608 [06/13/2021-16:49:05] [V] [TRT] Tactic: 25 time 0.195584 [06/13/2021-16:49:05] [V] [TRT] Tactic: 26 time 0.196608 [06/13/2021-16:49:05] [V] [TRT] Tactic: 27 time 0.19968 [06/13/2021-16:49:05] [V] [TRT] Tactic: 31 time 0.197632 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 25 Time: 0.195584 [06/13/2021-16:49:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [06/13/2021-16:49:05] [V] [TRT] [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.219136 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.293888 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.219136 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.365568 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 1.2031 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.365568 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.217088 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.719872 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.217088 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.41472 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 2.31014 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.41472 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.715776 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.722944 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.715776 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.413696 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.285696 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 0 Time: 0.285696 [06/13/2021-16:49:05] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,2097152) *************** [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_16 (FusedConvActConvolution) [06/13/2021-16:49:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_16 (CaskConvolution) [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 1062367460111450758 time 0.150368 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: 1698681053543049347 time 0.141312 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 4501471010995462441 time 0.32256 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 5137655947464784826 time 0.173056 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: 5288347012147084929 time 0.331552 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 5326823351883942011 time 0.315392 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: 5500448035057547314 time 0.192512 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 6645123197870846056 time 0.178176 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: 7144526460361122478 time 0.146432 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -8262349710178828730 time 0.3328 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -6576203419454146580 time 0.146432 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -4787320710726427159 time 0.147456 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -3456450830548107839 time 0.147456 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -1218658103698133241 time 0.200736 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -836875257600482091 time 0.196512 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -410470605513481746 time 0.319488 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -377491875521947884 time 0.324608 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -37215280111360163 time 0.173056 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 1698681053543049347 Time: 0.141312 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_16 (CudaConvolution) [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.258048 [06/13/2021-16:49:05] [V] [TRT] Tactic: 1 time 0.245728 [06/13/2021-16:49:05] [V] [TRT] Tactic: 2 time 0.43008 [06/13/2021-16:49:05] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1115955200, available: 524288000 [06/13/2021-16:49:05] [V] [TRT] Tactic: 5 time 0.723968 [06/13/2021-16:49:05] [V] [TRT] Tactic: 56 time 0.259072 [06/13/2021-16:49:05] [V] [TRT] Tactic: 57 time 0.24064 [06/13/2021-16:49:05] [V] [TRT] Tactic: 58 time 0.428032 [06/13/2021-16:49:05] [V] [TRT] Tactic: 60 skipped. Scratch requested: 1115955200, available: 524288000 [06/13/2021-16:49:05] [V] [TRT] Tactic: 61 time 0.723968 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 57 Time: 0.24064 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_16 (CudaDepthwiseConvolution) [06/13/2021-16:49:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_16 (CublasConvolution) [06/13/2021-16:49:05] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:05] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304) -> Float(32,8192,1,2097152) *************** [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_16 (FusedConvActConvolution) [06/13/2021-16:49:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_16 (CaskConvolution) [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 3886731678879822788 time 0.19968 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 6629944304117643200 time 0.159744 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -9153228964338181824 time 0.15872 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -7394439838318485025 time 0.201728 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.15872 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_16 (CudaConvolution) [06/13/2021-16:49:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_16 (CudaDepthwiseConvolution) [06/13/2021-16:49:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_16 (CublasConvolution) [06/13/2021-16:49:05] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.113664 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.144384 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.113664 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.181248 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.595968 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.181248 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.111616 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.36352 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.111616 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.171008 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.963584 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 1002 Time: 0.171008 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.364544 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.362496 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 0 Time: 0.362496 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:05] [V] [TRT] Tactic: 1002 time 0.16896 [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.132096 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 0 Time: 0.132096 [06/13/2021-16:49:05] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,2097152) -> Float(1,256,65536,2097152) *************** [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_17, Tanh_18), Mul_19) (PointWise) [06/13/2021-16:49:05] [V] [TRT] Tactic: 128 time 0.29696 [06/13/2021-16:49:05] [V] [TRT] Tactic: 256 time 0.29696 [06/13/2021-16:49:05] [V] [TRT] Tactic: 512 time 0.29696 [06/13/2021-16:49:05] [V] [TRT] Tactic: -32 time 0.33792 [06/13/2021-16:49:05] [V] [TRT] Tactic: -64 time 0.308224 [06/13/2021-16:49:05] [V] [TRT] Tactic: -128 time 0.305152 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 128 Time: 0.29696 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_17, Tanh_18), Mul_19) (PointWiseV2) [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 0.09216 [06/13/2021-16:49:05] [V] [TRT] Tactic: 1 time 0.08704 [06/13/2021-16:49:05] [V] [TRT] Tactic: 2 time 0.086016 [06/13/2021-16:49:05] [V] [TRT] Tactic: 3 time 0.086016 [06/13/2021-16:49:05] [V] [TRT] Tactic: 4 time 0.086016 [06/13/2021-16:49:05] [V] [TRT] Tactic: 5 time 0.086016 [06/13/2021-16:49:05] [V] [TRT] Tactic: 6 time 0.08704 [06/13/2021-16:49:05] [V] [TRT] Tactic: 7 time 0.086016 [06/13/2021-16:49:05] [V] [TRT] Tactic: 8 time 0.084992 [06/13/2021-16:49:05] [V] [TRT] Tactic: 9 time 0.086016 [06/13/2021-16:49:05] [V] [TRT] Tactic: 28 time 0.091136 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 8 Time: 0.084992 [06/13/2021-16:49:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [06/13/2021-16:49:05] [V] [TRT] [06/13/2021-16:49:05] [V] [TRT] *************** Autotuning format combination: Float(32,8192,1,2097152) -> Float(32,8192,1,2097152) *************** [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_17, Tanh_18), Mul_19) (PointWise) [06/13/2021-16:49:05] [V] [TRT] Tactic: 128 time 0.295936 [06/13/2021-16:49:05] [V] [TRT] Tactic: 256 time 0.29696 [06/13/2021-16:49:05] [V] [TRT] Tactic: 512 time 0.29696 [06/13/2021-16:49:05] [V] [TRT] Tactic: -32 time 0.33792 [06/13/2021-16:49:05] [V] [TRT] Tactic: -64 time 0.308224 [06/13/2021-16:49:05] [V] [TRT] Tactic: -128 time 0.306176 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 128 Time: 0.295936 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_17, Tanh_18), Mul_19) (PointWiseV2) [06/13/2021-16:49:05] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:05] [V] [TRT] [06/13/2021-16:49:05] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536:32,65536) -> Float(1,256,65536:32,65536) *************** [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_17, Tanh_18), Mul_19) (PointWise) [06/13/2021-16:49:05] [V] [TRT] Tactic: 128 time 0.295936 [06/13/2021-16:49:05] [V] [TRT] Tactic: 256 time 0.29696 [06/13/2021-16:49:05] [V] [TRT] Tactic: 512 time 0.29696 [06/13/2021-16:49:05] [V] [TRT] Tactic: -32 time 0.336896 [06/13/2021-16:49:05] [V] [TRT] Tactic: -64 time 0.308224 [06/13/2021-16:49:05] [V] [TRT] Tactic: -128 time 0.305152 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 128 Time: 0.295936 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_17, Tanh_18), Mul_19) (PointWiseV2) [06/13/2021-16:49:05] [V] [TRT] Tactic: 24 time 0.09856 [06/13/2021-16:49:05] [V] [TRT] Tactic: 25 time 0.098304 [06/13/2021-16:49:05] [V] [TRT] Tactic: 26 time 0.100352 [06/13/2021-16:49:05] [V] [TRT] Tactic: 27 time 0.103424 [06/13/2021-16:49:05] [V] [TRT] Tactic: 31 time 0.098304 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 25 Time: 0.098304 [06/13/2021-16:49:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [06/13/2021-16:49:05] [V] [TRT] [06/13/2021-16:49:05] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,2097152) -> Float(1,256,65536,4194304) *************** [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_20 (FusedConvActConvolution) [06/13/2021-16:49:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_20 (CaskConvolution) [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 1062367460111450758 time 0.582656 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: 1754984623894446479 time 0.674816 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: 3611739942397549984 time 0.965632 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 3827454225649558724 time 0.36352 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 4337000649858996379 time 0.521248 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 4501471010995462441 time 0.959488 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 5137655947464784826 time 0.499712 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: 5288347012147084929 time 0.950272 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 5921334924264294896 time 0.376832 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 6645123197870846056 time 0.516096 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: 7144526460361122478 time 0.654336 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: 7852627285308570038 time 0.359424 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -9137461792520977713 time 0.893952 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -8776506421218919509 time 0.34304 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -8262349710178828730 time 0.886784 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -8133971918129952780 time 0.513024 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -6092040395344634144 time 0.549888 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -4787320710726427159 time 0.623616 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -3456450830548107839 time 0.50688 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -2318106587342035239 time 0.351232 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -1343271414618805657 time 0.325632 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -1218658103698133241 time 0.514048 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Tactic: -836875257600482091 time 0.49664 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -410470605513481746 time 0.86528 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: -1343271414618805657 Time: 0.325632 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_20 (CudaConvolution) [06/13/2021-16:49:05] [V] [TRT] Tactic: 0 time 1.14074 [06/13/2021-16:49:05] [V] [TRT] Tactic: 1 time 0.999424 [06/13/2021-16:49:05] [V] [TRT] Tactic: 2 time 1.4848 [06/13/2021-16:49:05] [V] [TRT] Tactic: 5 time 4.99424 [06/13/2021-16:49:05] [V] [TRT] Tactic: 6 time 0.498688 [06/13/2021-16:49:05] [V] [TRT] Tactic: 56 time 1.14074 [06/13/2021-16:49:05] [V] [TRT] Tactic: 57 time 0.994272 [06/13/2021-16:49:05] [V] [TRT] Tactic: 58 time 1.48173 [06/13/2021-16:49:05] [V] [TRT] Tactic: 61 time 4.99814 [06/13/2021-16:49:05] [V] [TRT] Tactic: 62 time 0.498688 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: 6 Time: 0.498688 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_20 (CudaDepthwiseConvolution) [06/13/2021-16:49:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_20 (CublasConvolution) [06/13/2021-16:49:05] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1343271414618805657 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:05] [V] [TRT] [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:05] [V] [TRT] *************** Autotuning format combination: Float(32,8192,1,2097152) -> Float(64,16384,1,4194304) *************** [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_20 (FusedConvActConvolution) [06/13/2021-16:49:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_20 (CaskConvolution) [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -9153228964338181824 time 0.528384 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Tactic: -7394439838318485025 time 0.458752 [06/13/2021-16:49:05] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.458752 [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_20 (CudaConvolution) [06/13/2021-16:49:05] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_20 (CudaDepthwiseConvolution) [06/13/2021-16:49:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] --------------- Timing Runner: Conv_20 (CublasConvolution) [06/13/2021-16:49:05] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:05] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304), Float(1,256,65536,4194304) -> Float(1,256,65536,4194304) *************** [06/13/2021-16:49:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_21, Tanh_22), Mul_23), Add_24) (PointWise) [06/13/2021-16:49:07] [V] [TRT] Tactic: 128 time 0.617472 [06/13/2021-16:49:07] [V] [TRT] Tactic: 256 time 0.617472 [06/13/2021-16:49:07] [V] [TRT] Tactic: 512 time 0.617472 [06/13/2021-16:49:07] [V] [TRT] Tactic: -32 time 0.67072 [06/13/2021-16:49:07] [V] [TRT] Tactic: -64 time 0.635904 [06/13/2021-16:49:07] [V] [TRT] Tactic: -128 time 0.632832 [06/13/2021-16:49:07] [V] [TRT] Fastest Tactic: 128 Time: 0.617472 [06/13/2021-16:49:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_21, Tanh_22), Mul_23), Add_24) (PointWiseV2) [06/13/2021-16:49:07] [V] [TRT] Tactic: 0 time 0.246784 [06/13/2021-16:49:07] [V] [TRT] Tactic: 1 time 0.243712 [06/13/2021-16:49:07] [V] [TRT] Tactic: 2 time 0.243712 [06/13/2021-16:49:07] [V] [TRT] Tactic: 3 time 0.24064 [06/13/2021-16:49:07] [V] [TRT] Tactic: 4 time 0.241664 [06/13/2021-16:49:07] [V] [TRT] Tactic: 5 time 0.243712 [06/13/2021-16:49:07] [V] [TRT] Tactic: 6 time 0.244736 [06/13/2021-16:49:07] [V] [TRT] Tactic: 7 time 0.244736 [06/13/2021-16:49:07] [V] [TRT] Tactic: 8 time 0.243712 [06/13/2021-16:49:07] [V] [TRT] Tactic: 9 time 0.243712 [06/13/2021-16:49:07] [V] [TRT] Tactic: 28 time 0.24576 [06/13/2021-16:49:07] [V] [TRT] Fastest Tactic: 3 Time: 0.24064 [06/13/2021-16:49:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [06/13/2021-16:49:07] [V] [TRT] [06/13/2021-16:49:07] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304), Float(64,16384,1,4194304) -> Float(64,16384,1,4194304) *************** [06/13/2021-16:49:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_21, Tanh_22), Mul_23), Add_24) (PointWise) [06/13/2021-16:49:07] [V] [TRT] Tactic: 128 time 0.617472 [06/13/2021-16:49:07] [V] [TRT] Tactic: 256 time 0.616448 [06/13/2021-16:49:07] [V] [TRT] Tactic: 512 time 0.618496 [06/13/2021-16:49:07] [V] [TRT] Tactic: -32 time 0.671744 [06/13/2021-16:49:07] [V] [TRT] Tactic: -64 time 0.635904 [06/13/2021-16:49:07] [V] [TRT] Tactic: -128 time 0.632832 [06/13/2021-16:49:07] [V] [TRT] Fastest Tactic: 256 Time: 0.616448 [06/13/2021-16:49:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_21, Tanh_22), Mul_23), Add_24) (PointWiseV2) [06/13/2021-16:49:07] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 256 [06/13/2021-16:49:07] [V] [TRT] [06/13/2021-16:49:07] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536:32,131072), Float(1,256,65536:32,131072) -> Float(1,256,65536:32,131072) *************** [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_21, Tanh_22), Mul_23), Add_24) (PointWise) [06/13/2021-16:49:08] [V] [TRT] Tactic: 128 time 0.617472 [06/13/2021-16:49:08] [V] [TRT] Tactic: 256 time 0.617472 [06/13/2021-16:49:08] [V] [TRT] Tactic: 512 time 0.617472 [06/13/2021-16:49:08] [V] [TRT] Tactic: -32 time 0.67072 [06/13/2021-16:49:08] [V] [TRT] Tactic: -64 time 0.635904 [06/13/2021-16:49:08] [V] [TRT] Tactic: -128 time 0.632832 [06/13/2021-16:49:08] [V] [TRT] Fastest Tactic: 128 Time: 0.617472 [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_21, Tanh_22), Mul_23), Add_24) (PointWiseV2) [06/13/2021-16:49:08] [V] [TRT] Tactic: 24 time 0.359424 [06/13/2021-16:49:08] [V] [TRT] Tactic: 25 time 0.315392 [06/13/2021-16:49:08] [V] [TRT] Tactic: 26 time 0.319488 [06/13/2021-16:49:08] [V] [TRT] Tactic: 27 time 0.318464 [06/13/2021-16:49:08] [V] [TRT] Tactic: 31 time 0.357376 [06/13/2021-16:49:08] [V] [TRT] Fastest Tactic: 25 Time: 0.315392 [06/13/2021-16:49:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [06/13/2021-16:49:08] [V] [TRT] [06/13/2021-16:49:08] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,4194304) *************** [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: Conv_25 (FusedConvActConvolution) [06/13/2021-16:49:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: Conv_25 (CaskConvolution) [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: 1062367460111450758 time 0.270336 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Tactic: 1698681053543049347 time 0.265216 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: 4501471010995462441 time 0.282624 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: 5137655947464784826 time 0.185344 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Tactic: 5288347012147084929 time 0.285696 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: 5326823351883942011 time 0.27648 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Tactic: 5500448035057547314 time 0.198656 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: 6645123197870846056 time 0.185344 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Tactic: 7144526460361122478 time 0.272384 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Tactic: -8262349710178828730 time 0.287744 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: -6576203419454146580 time 0.268288 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Tactic: -4787320710726427159 time 0.270336 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: -3456450830548107839 time 0.269312 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Tactic: -1218658103698133241 time 0.203776 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Tactic: -836875257600482091 time 0.19968 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: -410470605513481746 time 0.279552 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Tactic: -377491875521947884 time 0.2816 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: -37215280111360163 time 0.187392 [06/13/2021-16:49:08] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.185344 [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: Conv_25 (CudaConvolution) [06/13/2021-16:49:08] [V] [TRT] Tactic: 0 time 0.442368 [06/13/2021-16:49:08] [V] [TRT] Tactic: 1 time 0.36352 [06/13/2021-16:49:08] [V] [TRT] Tactic: 2 time 0.616448 [06/13/2021-16:49:08] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2198093824, available: 524288000 [06/13/2021-16:49:08] [V] [TRT] Tactic: 5 time 0.951296 [06/13/2021-16:49:08] [V] [TRT] Tactic: 56 time 0.441344 [06/13/2021-16:49:08] [V] [TRT] Tactic: 57 time 0.361472 [06/13/2021-16:49:08] [V] [TRT] Tactic: 58 time 0.615424 [06/13/2021-16:49:08] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2198093824, available: 524288000 [06/13/2021-16:49:08] [V] [TRT] Tactic: 61 time 0.953344 [06/13/2021-16:49:08] [V] [TRT] Fastest Tactic: 57 Time: 0.361472 [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: Conv_25 (CudaDepthwiseConvolution) [06/13/2021-16:49:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: Conv_25 (CublasConvolution) [06/13/2021-16:49:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:08] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304) -> Float(64,16384,1,4194304) *************** [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: Conv_25 (FusedConvActConvolution) [06/13/2021-16:49:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: Conv_25 (CaskConvolution) [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: 3886731678879822788 time 0.200704 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: 6629944304117643200 time 0.246784 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: -9153228964338181824 time 0.249856 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Tactic: -7394439838318485025 time 0.198656 [06/13/2021-16:49:08] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.198656 [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: Conv_25 (CudaConvolution) [06/13/2021-16:49:08] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: Conv_25 (CudaDepthwiseConvolution) [06/13/2021-16:49:08] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: Conv_25 (CublasConvolution) [06/13/2021-16:49:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:08] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,8388608) -> Float(1,256,65536,8388608) *************** [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_9, Tanh_10), Mul_11) (PointWise) [06/13/2021-16:49:08] [V] [TRT] Tactic: 128 time 0.608256 [06/13/2021-16:49:08] [V] [TRT] Tactic: 256 time 0.608256 [06/13/2021-16:49:08] [V] [TRT] Tactic: 512 time 0.606208 [06/13/2021-16:49:08] [V] [TRT] Tactic: -32 time 0.581632 [06/13/2021-16:49:08] [V] [TRT] Tactic: -64 time 0.556032 [06/13/2021-16:49:08] [V] [TRT] Tactic: -128 time 0.557056 [06/13/2021-16:49:08] [V] [TRT] Fastest Tactic: -64 Time: 0.556032 [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_9, Tanh_10), Mul_11) (PointWiseV2) [06/13/2021-16:49:08] [V] [TRT] Tactic: 0 time 0.197632 [06/13/2021-16:49:08] [V] [TRT] Tactic: 1 time 0.16896 [06/13/2021-16:49:08] [V] [TRT] Tactic: 2 time 0.16896 [06/13/2021-16:49:08] [V] [TRT] Tactic: 3 time 0.166912 [06/13/2021-16:49:08] [V] [TRT] Tactic: 4 time 0.167936 [06/13/2021-16:49:08] [V] [TRT] Tactic: 5 time 0.169216 [06/13/2021-16:49:08] [V] [TRT] Tactic: 6 time 0.16896 [06/13/2021-16:49:08] [V] [TRT] Tactic: 7 time 0.166912 [06/13/2021-16:49:08] [V] [TRT] Tactic: 8 time 0.167936 [06/13/2021-16:49:08] [V] [TRT] Tactic: 9 time 0.166912 [06/13/2021-16:49:08] [V] [TRT] Tactic: 28 time 0.190464 [06/13/2021-16:49:08] [V] [TRT] Fastest Tactic: 3 Time: 0.166912 [06/13/2021-16:49:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [06/13/2021-16:49:08] [V] [TRT] [06/13/2021-16:49:08] [V] [TRT] *************** Autotuning format combination: Float(128,32768,1,8388608) -> Float(128,32768,1,8388608) *************** [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_9, Tanh_10), Mul_11) (PointWise) [06/13/2021-16:49:08] [V] [TRT] Tactic: 128 time 0.608256 [06/13/2021-16:49:08] [V] [TRT] Tactic: 256 time 0.608256 [06/13/2021-16:49:08] [V] [TRT] Tactic: 512 time 0.607232 [06/13/2021-16:49:08] [V] [TRT] Tactic: -32 time 0.618496 [06/13/2021-16:49:08] [V] [TRT] Tactic: -64 time 0.654336 [06/13/2021-16:49:08] [V] [TRT] Tactic: -128 time 0.654336 [06/13/2021-16:49:08] [V] [TRT] Fastest Tactic: 512 Time: 0.607232 [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_9, Tanh_10), Mul_11) (PointWiseV2) [06/13/2021-16:49:08] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 512 [06/13/2021-16:49:08] [V] [TRT] [06/13/2021-16:49:08] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536:32,262144) -> Float(1,256,65536:32,262144) *************** [06/13/2021-16:49:08] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_9, Tanh_10), Mul_11) (PointWise) [06/13/2021-16:49:08] [V] [TRT] Tactic: 128 time 0.608256 [06/13/2021-16:49:08] [V] [TRT] Tactic: 256 time 0.608256 [06/13/2021-16:49:08] [V] [TRT] Tactic: 512 time 0.607232 [06/13/2021-16:49:08] [V] [TRT] Tactic: -32 time 0.581632 [06/13/2021-16:49:09] [V] [TRT] Tactic: -64 time 0.556032 [06/13/2021-16:49:09] [V] [TRT] Tactic: -128 time 0.557056 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: -64 Time: 0.556032 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_9, Tanh_10), Mul_11) (PointWiseV2) [06/13/2021-16:49:09] [V] [TRT] Tactic: 24 time 0.192512 [06/13/2021-16:49:09] [V] [TRT] Tactic: 25 time 0.192512 [06/13/2021-16:49:09] [V] [TRT] Tactic: 26 time 0.19456 [06/13/2021-16:49:09] [V] [TRT] Tactic: 27 time 0.197632 [06/13/2021-16:49:09] [V] [TRT] Tactic: 31 time 0.192512 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 24 Time: 0.192512 [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.201728 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.282624 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.201728 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.319488 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 1.18579 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.319488 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.195584 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.724992 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.195584 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.371712 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 2.36134 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.371712 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.695296 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.720896 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.695296 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.367616 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.237568 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 0 Time: 0.237568 [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,8388608) *************** [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_26, Tanh_27), Mul_28) (PointWise) [06/13/2021-16:49:09] [V] [TRT] Tactic: 128 time 0.608256 [06/13/2021-16:49:09] [V] [TRT] Tactic: 256 time 0.608256 [06/13/2021-16:49:09] [V] [TRT] Tactic: 512 time 0.607232 [06/13/2021-16:49:09] [V] [TRT] Tactic: -32 time 0.581632 [06/13/2021-16:49:09] [V] [TRT] Tactic: -64 time 0.556032 [06/13/2021-16:49:09] [V] [TRT] Tactic: -128 time 0.557056 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: -64 Time: 0.556032 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_26, Tanh_27), Mul_28) (PointWiseV2) [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.198656 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1 time 0.16896 [06/13/2021-16:49:09] [V] [TRT] Tactic: 2 time 0.16896 [06/13/2021-16:49:09] [V] [TRT] Tactic: 3 time 0.16896 [06/13/2021-16:49:09] [V] [TRT] Tactic: 4 time 0.166912 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5 time 0.167936 [06/13/2021-16:49:09] [V] [TRT] Tactic: 6 time 0.167936 [06/13/2021-16:49:09] [V] [TRT] Tactic: 7 time 0.16896 [06/13/2021-16:49:09] [V] [TRT] Tactic: 8 time 0.167936 [06/13/2021-16:49:09] [V] [TRT] Tactic: 9 time 0.16816 [06/13/2021-16:49:09] [V] [TRT] Tactic: 28 time 0.190464 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 4 Time: 0.166912 [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304) -> Float(128,32768,1,8388608) *************** [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_26, Tanh_27), Mul_28) (PointWise) [06/13/2021-16:49:09] [V] [TRT] Tactic: 128 time 0.608256 [06/13/2021-16:49:09] [V] [TRT] Tactic: 256 time 0.607232 [06/13/2021-16:49:09] [V] [TRT] Tactic: 512 time 0.606208 [06/13/2021-16:49:09] [V] [TRT] Tactic: -32 time 0.618496 [06/13/2021-16:49:09] [V] [TRT] Tactic: -64 time 0.654336 [06/13/2021-16:49:09] [V] [TRT] Tactic: -128 time 0.654336 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 512 Time: 0.606208 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_26, Tanh_27), Mul_28) (PointWiseV2) [06/13/2021-16:49:09] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 512 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536:32,131072) -> Float(1,256,65536:32,262144) *************** [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_26, Tanh_27), Mul_28) (PointWise) [06/13/2021-16:49:09] [V] [TRT] Tactic: 128 time 0.608256 [06/13/2021-16:49:09] [V] [TRT] Tactic: 256 time 0.607232 [06/13/2021-16:49:09] [V] [TRT] Tactic: 512 time 0.606208 [06/13/2021-16:49:09] [V] [TRT] Tactic: -32 time 0.582656 [06/13/2021-16:49:09] [V] [TRT] Tactic: -64 time 0.556032 [06/13/2021-16:49:09] [V] [TRT] Tactic: -128 time 0.557056 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: -64 Time: 0.556032 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_26, Tanh_27), Mul_28) (PointWiseV2) [06/13/2021-16:49:09] [V] [TRT] Tactic: 24 time 0.191488 [06/13/2021-16:49:09] [V] [TRT] Tactic: 25 time 0.193536 [06/13/2021-16:49:09] [V] [TRT] Tactic: 26 time 0.195584 [06/13/2021-16:49:09] [V] [TRT] Tactic: 27 time 0.198656 [06/13/2021-16:49:09] [V] [TRT] Tactic: 31 time 0.193536 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 24 Time: 0.191488 [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.407552 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.996352 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.407552 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.398336 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 2.05824 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.398336 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 1.27386 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 1.44384 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 1.27386 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.69632 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.47104 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 0 Time: 0.47104 [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,8388608) -> Float(1,256,65536,4194304) *************** [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_30 (FusedConvActConvolution) [06/13/2021-16:49:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_30 (CaskConvolution) [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1062367460111450758 time 0.4352 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1698681053543049347 time 0.441344 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 4501471010995462441 time 0.453632 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5137655947464784826 time 0.285696 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5288347012147084929 time 0.458752 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5326823351883942011 time 0.442368 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5500448035057547314 time 0.315392 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 6645123197870846056 time 0.288768 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 7144526460361122478 time 0.462848 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -8262349710178828730 time 0.461824 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -6576203419454146580 time 0.432128 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -4787320710726427159 time 0.463872 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -3456450830548107839 time 0.433152 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -1218658103698133241 time 0.32256 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -836875257600482091 time 0.320512 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -410470605513481746 time 0.44544 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -377491875521947884 time 0.452608 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -37215280111360163 time 0.285696 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.285696 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_30 (CudaConvolution) [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.800768 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1 time 0.45568 [06/13/2021-16:49:09] [V] [TRT] Tactic: 2 time 0.96768 [06/13/2021-16:49:09] [V] [TRT] Tactic: 4 skipped. Scratch requested: 4396187648, available: 524288000 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5 time 1.39162 [06/13/2021-16:49:09] [V] [TRT] Tactic: 56 time 0.802816 [06/13/2021-16:49:09] [V] [TRT] Tactic: 57 time 0.4608 [06/13/2021-16:49:09] [V] [TRT] Tactic: 58 time 0.971776 [06/13/2021-16:49:09] [V] [TRT] Tactic: 60 skipped. Scratch requested: 4396187648, available: 524288000 [06/13/2021-16:49:09] [V] [TRT] Tactic: 61 time 1.39466 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1 Time: 0.45568 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_30 (CudaDepthwiseConvolution) [06/13/2021-16:49:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_30 (CublasConvolution) [06/13/2021-16:49:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(128,32768,1,8388608) -> Float(64,16384,1,4194304) *************** [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_30 (FusedConvActConvolution) [06/13/2021-16:49:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_30 (CaskConvolution) [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 3886731678879822788 time 0.278528 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 6629944304117643200 time 0.335872 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -9153228964338181824 time 0.338944 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -7394439838318485025 time 0.278528 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.278528 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_30 (CudaConvolution) [06/13/2021-16:49:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_30 (CudaDepthwiseConvolution) [06/13/2021-16:49:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_30 (CublasConvolution) [06/13/2021-16:49:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,256,65536,4194304) *************** [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304) -> Float(64,16384,1,4194304) *************** [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536:32,131072) -> Float(1,256,65536:32,131072) *************** [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,256,65536,4194304) -> Float(1,128,16384,2097152) *************** [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_34 (FusedConvActConvolution) [06/13/2021-16:49:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_34 (CaskConvolution) [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1062367460111450758 time 0.555008 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1754984623894446479 time 0.66048 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 3611739942397549984 time 0.454656 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 4337000649858996379 time 0.473088 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 4501471010995462441 time 0.451584 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5137655947464784826 time 0.454656 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5288347012147084929 time 0.449536 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 6645123197870846056 time 0.466944 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 7144526460361122478 time 0.646144 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -9137461792520977713 time 0.457728 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -8262349710178828730 time 0.453632 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -8133971918129952780 time 0.55296 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -6092040395344634144 time 0.570368 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -4787320710726427159 time 0.654336 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -3456450830548107839 time 0.538624 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -1218658103698133241 time 0.54784 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -836875257600482091 time 0.535552 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -410470605513481746 time 0.443392 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: -410470605513481746 Time: 0.443392 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_34 (CudaConvolution) [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.81408 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1 time 0.540672 [06/13/2021-16:49:09] [V] [TRT] Tactic: 2 time 1.02502 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5 time 15.1101 [06/13/2021-16:49:09] [V] [TRT] Tactic: 56 time 0.816128 [06/13/2021-16:49:09] [V] [TRT] Tactic: 57 time 0.541696 [06/13/2021-16:49:09] [V] [TRT] Tactic: 58 time 0.997376 [06/13/2021-16:49:09] [V] [TRT] Tactic: 61 time 15.1132 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1 Time: 0.540672 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_34 (CudaDepthwiseConvolution) [06/13/2021-16:49:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_34 (CublasConvolution) [06/13/2021-16:49:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -410470605513481746 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(64,16384,1,4194304) -> Float(128,16384,1,2097152) *************** [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_34 (FusedConvActConvolution) [06/13/2021-16:49:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_34 (CaskConvolution) [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -9153228964338181824 time 0.466944 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -7394439838318485025 time 0.433152 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.433152 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_34 (CudaConvolution) [06/13/2021-16:49:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_34 (CudaDepthwiseConvolution) [06/13/2021-16:49:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_34 (CublasConvolution) [06/13/2021-16:49:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.101376 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.130048 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.101376 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.155648 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.488448 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.155648 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.098304 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.223232 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.098304 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.181248 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.949248 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.181248 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.251904 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.16384 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 0 Time: 0.16384 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.176128 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.120832 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 0 Time: 0.120832 [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,2097152) *************** [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_35, Tanh_36), Mul_37) (PointWise) [06/13/2021-16:49:09] [V] [TRT] Tactic: 128 time 0.270336 [06/13/2021-16:49:09] [V] [TRT] Tactic: 256 time 0.27136 [06/13/2021-16:49:09] [V] [TRT] Tactic: 512 time 0.27136 [06/13/2021-16:49:09] [V] [TRT] Tactic: -32 time 0.309248 [06/13/2021-16:49:09] [V] [TRT] Tactic: -64 time 0.283648 [06/13/2021-16:49:09] [V] [TRT] Tactic: -128 time 0.278528 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 128 Time: 0.270336 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_35, Tanh_36), Mul_37) (PointWiseV2) [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.088064 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1 time 0.08704 [06/13/2021-16:49:09] [V] [TRT] Tactic: 2 time 0.086016 [06/13/2021-16:49:09] [V] [TRT] Tactic: 3 time 0.086016 [06/13/2021-16:49:09] [V] [TRT] Tactic: 4 time 0.084992 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5 time 0.086016 [06/13/2021-16:49:09] [V] [TRT] Tactic: 6 time 0.086016 [06/13/2021-16:49:09] [V] [TRT] Tactic: 7 time 0.084992 [06/13/2021-16:49:09] [V] [TRT] Tactic: 8 time 0.085984 [06/13/2021-16:49:09] [V] [TRT] Tactic: 9 time 0.084992 [06/13/2021-16:49:09] [V] [TRT] Tactic: 28 time 0.08704 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 4 Time: 0.084992 [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(128,16384,1,2097152) -> Float(128,16384,1,2097152) *************** [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_35, Tanh_36), Mul_37) (PointWise) [06/13/2021-16:49:09] [V] [TRT] Tactic: 128 time 0.270336 [06/13/2021-16:49:09] [V] [TRT] Tactic: 256 time 0.27136 [06/13/2021-16:49:09] [V] [TRT] Tactic: 512 time 0.27136 [06/13/2021-16:49:09] [V] [TRT] Tactic: -32 time 0.308224 [06/13/2021-16:49:09] [V] [TRT] Tactic: -64 time 0.283648 [06/13/2021-16:49:09] [V] [TRT] Tactic: -128 time 0.279552 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 128 Time: 0.270336 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_35, Tanh_36), Mul_37) (PointWiseV2) [06/13/2021-16:49:09] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384:32,65536) -> Float(1,128,16384:32,65536) *************** [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_35, Tanh_36), Mul_37) (PointWise) [06/13/2021-16:49:09] [V] [TRT] Tactic: 128 time 0.270336 [06/13/2021-16:49:09] [V] [TRT] Tactic: 256 time 0.27136 [06/13/2021-16:49:09] [V] [TRT] Tactic: 512 time 0.27136 [06/13/2021-16:49:09] [V] [TRT] Tactic: -32 time 0.308224 [06/13/2021-16:49:09] [V] [TRT] Tactic: -64 time 0.283648 [06/13/2021-16:49:09] [V] [TRT] Tactic: -128 time 0.279552 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 128 Time: 0.270336 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_35, Tanh_36), Mul_37) (PointWiseV2) [06/13/2021-16:49:09] [V] [TRT] Tactic: 24 time 0.09728 [06/13/2021-16:49:09] [V] [TRT] Tactic: 25 time 0.09728 [06/13/2021-16:49:09] [V] [TRT] Tactic: 26 time 0.099328 [06/13/2021-16:49:09] [V] [TRT] Tactic: 27 time 0.104448 [06/13/2021-16:49:09] [V] [TRT] Tactic: 31 time 0.097376 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 24 Time: 0.09728 [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,2097152) *************** [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_38 || Conv_42 (FusedConvActConvolution) [06/13/2021-16:49:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_38 || Conv_42 (CaskConvolution) [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1062367460111450758 time 0.22528 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1698681053543049347 time 0.22528 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 4501471010995462441 time 0.13312 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5137655947464784826 time 0.150528 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5288347012147084929 time 0.132096 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5326823351883942011 time 0.131072 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5500448035057547314 time 0.166912 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 6645123197870846056 time 0.151552 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: 7144526460361122478 time 0.232448 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -8262349710178828730 time 0.131072 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -6576203419454146580 time 0.223232 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -4787320710726427159 time 0.232448 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -3456450830548107839 time 0.224256 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -1218658103698133241 time 0.172032 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -836875257600482091 time 0.169984 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -410470605513481746 time 0.134144 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Tactic: -377491875521947884 time 0.141312 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -37215280111360163 time 0.149504 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.131072 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_38 || Conv_42 (CudaConvolution) [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.27136 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1 time 0.241664 [06/13/2021-16:49:09] [V] [TRT] Tactic: 2 time 0.355328 [06/13/2021-16:49:09] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2198142976, available: 524288000 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5 time 0.518144 [06/13/2021-16:49:09] [V] [TRT] Tactic: 56 time 0.273408 [06/13/2021-16:49:09] [V] [TRT] Tactic: 57 time 0.24064 [06/13/2021-16:49:09] [V] [TRT] Tactic: 58 time 0.352256 [06/13/2021-16:49:09] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2198142976, available: 524288000 [06/13/2021-16:49:09] [V] [TRT] Tactic: 61 time 0.518144 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 57 Time: 0.24064 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_38 || Conv_42 (CudaDepthwiseConvolution) [06/13/2021-16:49:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_38 || Conv_42 (CublasConvolution) [06/13/2021-16:49:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(128,16384,1,2097152) -> Float(128,16384,1,2097152) *************** [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_38 || Conv_42 (FusedConvActConvolution) [06/13/2021-16:49:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_38 || Conv_42 (CaskConvolution) [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 3886731678879822788 time 0.139264 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: 6629944304117643200 time 0.162816 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -9153228964338181824 time 0.165056 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Tactic: -7394439838318485025 time 0.136192 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.136192 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_38 || Conv_42 (CudaConvolution) [06/13/2021-16:49:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_38 || Conv_42 (CudaDepthwiseConvolution) [06/13/2021-16:49:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: Conv_38 || Conv_42 (CublasConvolution) [06/13/2021-16:49:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.1024 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.130048 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.1024 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.160768 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.488448 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.160768 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.099328 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.226304 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.099328 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.183296 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.932864 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.183296 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.0512 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.065536 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0512 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.08192 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.238592 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.08192 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.050176 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.114688 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.050176 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.095232 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.473088 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.095232 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.131072 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.083968 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 0 Time: 0.083968 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.091136 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.062464 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 0 Time: 0.062464 [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,1048576) *************** [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_43, Tanh_44), Mul_45) (PointWise) [06/13/2021-16:49:09] [V] [TRT] Tactic: 128 time 0.155648 [06/13/2021-16:49:09] [V] [TRT] Tactic: 256 time 0.155648 [06/13/2021-16:49:09] [V] [TRT] Tactic: 512 time 0.155648 [06/13/2021-16:49:09] [V] [TRT] Tactic: -32 time 0.178176 [06/13/2021-16:49:09] [V] [TRT] Tactic: -64 time 0.150528 [06/13/2021-16:49:09] [V] [TRT] Tactic: -128 time 0.146432 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: -128 Time: 0.146432 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_43, Tanh_44), Mul_45) (PointWiseV2) [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.052224 [06/13/2021-16:49:09] [V] [TRT] Tactic: 1 time 0.045056 [06/13/2021-16:49:09] [V] [TRT] Tactic: 2 time 0.045056 [06/13/2021-16:49:09] [V] [TRT] Tactic: 3 time 0.045056 [06/13/2021-16:49:09] [V] [TRT] Tactic: 4 time 0.045056 [06/13/2021-16:49:09] [V] [TRT] Tactic: 5 time 0.044032 [06/13/2021-16:49:09] [V] [TRT] Tactic: 6 time 0.045056 [06/13/2021-16:49:09] [V] [TRT] Tactic: 7 time 0.045056 [06/13/2021-16:49:09] [V] [TRT] Tactic: 8 time 0.044032 [06/13/2021-16:49:09] [V] [TRT] Tactic: 9 time 0.044032 [06/13/2021-16:49:09] [V] [TRT] Tactic: 28 time 0.050176 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 5 Time: 0.044032 [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(128,16384,1,2097152) -> Float(64,8192,1,1048576) *************** [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_43, Tanh_44), Mul_45) (PointWise) [06/13/2021-16:49:09] [V] [TRT] Tactic: 128 time 0.155648 [06/13/2021-16:49:09] [V] [TRT] Tactic: 256 time 0.155648 [06/13/2021-16:49:09] [V] [TRT] Tactic: 512 time 0.155648 [06/13/2021-16:49:09] [V] [TRT] Tactic: -32 time 0.15872 [06/13/2021-16:49:09] [V] [TRT] Tactic: -64 time 0.166912 [06/13/2021-16:49:09] [V] [TRT] Tactic: -128 time 0.166912 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 128 Time: 0.155648 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_43, Tanh_44), Mul_45) (PointWiseV2) [06/13/2021-16:49:09] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384:32,65536) -> Float(1,128,16384:32,32768) *************** [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_43, Tanh_44), Mul_45) (PointWise) [06/13/2021-16:49:09] [V] [TRT] Tactic: 128 time 0.155648 [06/13/2021-16:49:09] [V] [TRT] Tactic: 256 time 0.155648 [06/13/2021-16:49:09] [V] [TRT] Tactic: 512 time 0.154624 [06/13/2021-16:49:09] [V] [TRT] Tactic: -32 time 0.178176 [06/13/2021-16:49:09] [V] [TRT] Tactic: -64 time 0.150528 [06/13/2021-16:49:09] [V] [TRT] Tactic: -128 time 0.146432 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: -128 Time: 0.146432 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_43, Tanh_44), Mul_45) (PointWiseV2) [06/13/2021-16:49:09] [V] [TRT] Tactic: 24 time 0.0512 [06/13/2021-16:49:09] [V] [TRT] Tactic: 25 time 0.0512 [06/13/2021-16:49:09] [V] [TRT] Tactic: 26 time 0.052224 [06/13/2021-16:49:09] [V] [TRT] Tactic: 27 time 0.05632 [06/13/2021-16:49:09] [V] [TRT] Tactic: 31 time 0.0512 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 24 Time: 0.0512 [06/13/2021-16:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:09] [V] [TRT] [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:09] [V] [TRT] Tactic: 1002 time 0.0512 [06/13/2021-16:49:09] [V] [TRT] Tactic: 0 time 0.065536 [06/13/2021-16:49:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.0512 [06/13/2021-16:49:09] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.079872 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.236544 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.079872 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.0512 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.088064 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0512 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.09216 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.425984 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.09216 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.132096 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.083968 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 0 Time: 0.083968 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.091136 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.062464 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 0 Time: 0.062464 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.052224 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.064512 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.052224 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.0512 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.088064 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0512 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.131072 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.084992 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 0 Time: 0.084992 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.091136 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.062464 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 0 Time: 0.062464 [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [06/13/2021-16:49:10] [V] [TRT] Tactic: 589823 time 0.175104 [06/13/2021-16:49:10] [V] [TRT] Tactic: 655359 time 0.160768 [06/13/2021-16:49:10] [V] [TRT] Tactic: 786431 time 0.147456 [06/13/2021-16:49:10] [V] [TRT] Tactic: 851967 time 0.183296 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1179647 time 0.132096 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1310719 time 0.393216 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1376255 time 0.140288 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1441791 time 0.176128 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1507327 time 0.166912 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1638399 time 0.155648 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1835007 time 0.145408 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1900543 time 0.1792 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2097151 time 0.16384 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2162687 time 0.14336 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2293759 time 0.145408 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2359295 time 0.128 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2686975 time 0.13824 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3080191 time 0.162816 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3342335 time 0.16384 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3407871 time 0.126976 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3538943 time 0.119808 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3670015 time 0.182272 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3932159 time 0.165888 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3997695 time 0.14848 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4063231 time 0.181248 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4194303 time 0.145408 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4259839 time 0.15872 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4325375 time 0.141312 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4521983 time 0.154624 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4587519 time 0.146432 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4653055 time 0.141312 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4915199 time 0.144384 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4980735 time 0.147456 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5177343 time 0.130048 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5242879 time 0.132096 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5373951 time 0.14336 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5439487 time 0.200704 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5570559 time 0.169984 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5636095 time 0.181248 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5701631 time 0.140288 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5767167 time 0.416768 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5832703 time 0.12288 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5898239 time 0.119808 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6029311 time 0.139264 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6225919 time 0.124928 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6291455 time 0.132096 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6422527 time 0.156672 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6750207 time 0.14848 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6815743 time 0.159744 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6946815 time 0.182272 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7012351 time 0.16384 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7077887 time 0.116736 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7143423 time 0.19456 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7208959 time 0.128 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7340031 time 0.119808 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7405567 time 0.128 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7536639 time 0.166912 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7602175 time 0.14848 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7733247 time 0.120832 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7798783 time 0.146432 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8191999 time 0.169984 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8257535 time 0.14336 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8323071 time 0.150528 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8650751 time 0.1536 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8716287 time 0.155648 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9109503 time 0.161792 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9568255 time 0.145408 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9895935 time 0.147456 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10223615 time 0.140288 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10354687 time 0.150528 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10551295 time 0.15872 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10747903 time 0.119808 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10944511 time 0.144384 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 7077887 Time: 0.116736 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_46 (CaskConvolution) [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1062367460111450758 time 0.078848 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1698681053543049347 time 0.070656 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4501471010995462441 time 0.0768 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5137655947464784826 time 0.054272 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5288347012147084929 time 0.078848 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5326823351883942011 time 0.075776 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5500448035057547314 time 0.059392 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6645123197870846056 time 0.054272 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7144526460361122478 time 0.075776 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -8262349710178828730 time 0.079872 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -6576203419454146580 time 0.077824 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -4787320710726427159 time 0.075776 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -3456450830548107839 time 0.077824 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -1218658103698133241 time 0.062464 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -836875257600482091 time 0.06144 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -410470605513481746 time 0.0768 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -377491875521947884 time 0.077824 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -37215280111360163 time 0.054272 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.054272 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaConvolution) [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.11776 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1 time 0.100352 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2 time 0.172032 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4 skipped. Scratch requested: 553795584, available: 524288000 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5 time 0.24064 [06/13/2021-16:49:10] [V] [TRT] Tactic: 56 time 0.116736 [06/13/2021-16:49:10] [V] [TRT] Tactic: 57 time 0.101376 [06/13/2021-16:49:10] [V] [TRT] Tactic: 58 time 0.171008 [06/13/2021-16:49:10] [V] [TRT] Tactic: 60 skipped. Scratch requested: 553795584, available: 524288000 [06/13/2021-16:49:10] [V] [TRT] Tactic: 61 time 0.24064 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1 Time: 0.100352 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [06/13/2021-16:49:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_46 (CublasConvolution) [06/13/2021-16:49:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(64,8192,1,1048576) -> Float(64,8192,1,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [06/13/2021-16:49:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_46 (CaskConvolution) [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3886731678879822788 time 0.057344 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6629944304117643200 time 0.070656 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -9153228964338181824 time 0.069632 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -7394439838318485025 time 0.057344 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.057344 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaConvolution) [06/13/2021-16:49:10] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [06/13/2021-16:49:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_46 (CublasConvolution) [06/13/2021-16:49:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.079872 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.239616 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.079872 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.093184 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.427008 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.093184 [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_47, Tanh_48), Mul_49) (PointWise) [06/13/2021-16:49:10] [V] [TRT] Tactic: 128 time 0.137216 [06/13/2021-16:49:10] [V] [TRT] Tactic: 256 time 0.137216 [06/13/2021-16:49:10] [V] [TRT] Tactic: 512 time 0.137216 [06/13/2021-16:49:10] [V] [TRT] Tactic: -32 time 0.177152 [06/13/2021-16:49:10] [V] [TRT] Tactic: -64 time 0.150528 [06/13/2021-16:49:10] [V] [TRT] Tactic: -128 time 0.14336 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 128 Time: 0.137216 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_47, Tanh_48), Mul_49) (PointWiseV2) [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.04608 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1 time 0.045056 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2 time 0.045056 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3 time 0.044032 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4 time 0.044032 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5 time 0.043008 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6 time 0.045056 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7 time 0.045056 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8 time 0.044032 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9 time 0.044032 [06/13/2021-16:49:10] [V] [TRT] Tactic: 28 time 0.045056 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 5 Time: 0.043008 [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(64,8192,1,1048576) -> Float(64,8192,1,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_47, Tanh_48), Mul_49) (PointWise) [06/13/2021-16:49:10] [V] [TRT] Tactic: 128 time 0.137216 [06/13/2021-16:49:10] [V] [TRT] Tactic: 256 time 0.137216 [06/13/2021-16:49:10] [V] [TRT] Tactic: 512 time 0.137216 [06/13/2021-16:49:10] [V] [TRT] Tactic: -32 time 0.177152 [06/13/2021-16:49:10] [V] [TRT] Tactic: -64 time 0.150528 [06/13/2021-16:49:10] [V] [TRT] Tactic: -128 time 0.14336 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 128 Time: 0.137216 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_47, Tanh_48), Mul_49) (PointWiseV2) [06/13/2021-16:49:10] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384:32,32768) -> Float(1,128,16384:32,32768) *************** [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_47, Tanh_48), Mul_49) (PointWise) [06/13/2021-16:49:10] [V] [TRT] Tactic: 128 time 0.137216 [06/13/2021-16:49:10] [V] [TRT] Tactic: 256 time 0.137216 [06/13/2021-16:49:10] [V] [TRT] Tactic: 512 time 0.137216 [06/13/2021-16:49:10] [V] [TRT] Tactic: -32 time 0.177824 [06/13/2021-16:49:10] [V] [TRT] Tactic: -64 time 0.149504 [06/13/2021-16:49:10] [V] [TRT] Tactic: -128 time 0.14336 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 128 Time: 0.137216 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_47, Tanh_48), Mul_49) (PointWiseV2) [06/13/2021-16:49:10] [V] [TRT] Tactic: 24 time 0.050176 [06/13/2021-16:49:10] [V] [TRT] Tactic: 25 time 0.050176 [06/13/2021-16:49:10] [V] [TRT] Tactic: 26 time 0.053248 [06/13/2021-16:49:10] [V] [TRT] Tactic: 27 time 0.05632 [06/13/2021-16:49:10] [V] [TRT] Tactic: 31 time 0.050176 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 24 Time: 0.050176 [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_50 (FusedConvActConvolution) [06/13/2021-16:49:10] [V] [TRT] Tactic: 524287 time 0.288768 [06/13/2021-16:49:10] [V] [TRT] Tactic: 720895 time 0.264192 [06/13/2021-16:49:10] [V] [TRT] Tactic: 983039 time 0.251904 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1048575 time 0.26112 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1703935 time 0.256 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1769471 time 0.385024 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1966079 time 0.272384 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2031615 time 0.27648 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2228223 time 0.29184 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2424831 time 0.454656 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2621439 time 0.278528 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2752511 time 0.273408 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2818047 time 0.699392 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2883583 time 0.512 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3014655 time 0.260096 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3145727 time 0.260096 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3473407 time 0.4864 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3604479 time 0.253952 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3735551 time 0.453632 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4390911 time 0.30208 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5046271 time 0.267264 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5963775 time 0.280576 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6160383 time 0.292864 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6488063 time 0.2816 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6881279 time 0.277504 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7274495 time 0.325632 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7864319 time 0.325632 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7995391 time 0.26112 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8585215 time 0.288768 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8847359 time 0.319488 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8978431 time 0.280576 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9043967 time 0.27648 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9175039 time 0.254976 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9502719 time 0.308224 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9830399 time 0.448512 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9961471 time 0.301056 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10027007 time 0.260096 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10092543 time 0.3072 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10289151 time 0.267264 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10485759 time 0.256 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10682367 time 0.277504 [06/13/2021-16:49:10] [V] [TRT] Tactic: 10813439 time 0.248832 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 10813439 Time: 0.248832 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_50 (CaskConvolution) [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1062367460111450758 time 0.283648 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1754984623894446479 time 0.319488 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3611739942397549984 time 0.439296 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3827454225649558724 time 0.136192 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4337000649858996379 time 0.248832 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4501471010995462441 time 0.437248 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5137655947464784826 time 0.23552 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5288347012147084929 time 0.431104 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5921334924264294896 time 0.141312 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6645123197870846056 time 0.242688 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7144526460361122478 time 0.308224 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7852627285308570038 time 0.14848 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -9137461792520977713 time 0.444416 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -8776506421218919509 time 0.137216 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -8262349710178828730 time 0.438272 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -8133971918129952780 time 0.285696 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -6092040395344634144 time 0.29184 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -4787320710726427159 time 0.319488 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -3456450830548107839 time 0.279552 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -2318106587342035239 time 0.142336 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -1343271414618805657 time 0.13824 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -1218658103698133241 time 0.284672 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Tactic: -836875257600482091 time 0.274432 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -410470605513481746 time 0.427008 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 3827454225649558724 Time: 0.136192 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_50 (CudaConvolution) [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.585728 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1 time 0.2816 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2 time 0.689152 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2198224896, available: 524288000 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5 time 2.57946 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6 time 0.183296 [06/13/2021-16:49:10] [V] [TRT] Tactic: 56 time 0.58368 [06/13/2021-16:49:10] [V] [TRT] Tactic: 57 time 0.2816 [06/13/2021-16:49:10] [V] [TRT] Tactic: 58 time 0.688128 [06/13/2021-16:49:10] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2198224896, available: 524288000 [06/13/2021-16:49:10] [V] [TRT] Tactic: 61 time 2.58355 [06/13/2021-16:49:10] [V] [TRT] Tactic: 62 time 0.18432 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 6 Time: 0.183296 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_50 (CudaDepthwiseConvolution) [06/13/2021-16:49:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_50 (CublasConvolution) [06/13/2021-16:49:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3827454225649558724 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(64,8192,1,1048576) -> Float(64,8192,1,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_50 (FusedConvActConvolution) [06/13/2021-16:49:10] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_50 (CaskConvolution) [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -9153228964338181824 time 0.241664 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Tactic: -7394439838318485025 time 0.221184 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.221184 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_50 (CudaConvolution) [06/13/2021-16:49:10] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_50 (CudaDepthwiseConvolution) [06/13/2021-16:49:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: Conv_50 (CublasConvolution) [06/13/2021-16:49:10] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576), Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_51, Tanh_52), Mul_53), Add_54) (PointWise) [06/13/2021-16:49:10] [V] [TRT] Tactic: 128 time 0.157696 [06/13/2021-16:49:10] [V] [TRT] Tactic: 256 time 0.157696 [06/13/2021-16:49:10] [V] [TRT] Tactic: 512 time 0.157696 [06/13/2021-16:49:10] [V] [TRT] Tactic: -32 time 0.205824 [06/13/2021-16:49:10] [V] [TRT] Tactic: -64 time 0.172032 [06/13/2021-16:49:10] [V] [TRT] Tactic: -128 time 0.164864 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 128 Time: 0.157696 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_51, Tanh_52), Mul_53), Add_54) (PointWiseV2) [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.063488 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1 time 0.063488 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2 time 0.063488 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3 time 0.063488 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4 time 0.063488 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5 time 0.064512 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6 time 0.064512 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7 time 0.063488 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8 time 0.063488 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9 time 0.063488 [06/13/2021-16:49:10] [V] [TRT] Tactic: 28 time 0.064512 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 0 Time: 0.063488 [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(64,8192,1,1048576), Float(64,8192,1,1048576) -> Float(64,8192,1,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_51, Tanh_52), Mul_53), Add_54) (PointWise) [06/13/2021-16:49:10] [V] [TRT] Tactic: 128 time 0.157696 [06/13/2021-16:49:10] [V] [TRT] Tactic: 256 time 0.157696 [06/13/2021-16:49:10] [V] [TRT] Tactic: 512 time 0.15872 [06/13/2021-16:49:10] [V] [TRT] Tactic: -32 time 0.205824 [06/13/2021-16:49:10] [V] [TRT] Tactic: -64 time 0.172032 [06/13/2021-16:49:10] [V] [TRT] Tactic: -128 time 0.164864 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 128 Time: 0.157696 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_51, Tanh_52), Mul_53), Add_54) (PointWiseV2) [06/13/2021-16:49:10] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384:32,32768), Float(1,128,16384:32,32768) -> Float(1,128,16384:32,32768) *************** [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_51, Tanh_52), Mul_53), Add_54) (PointWise) [06/13/2021-16:49:10] [V] [TRT] Tactic: 128 time 0.157696 [06/13/2021-16:49:10] [V] [TRT] Tactic: 256 time 0.157696 [06/13/2021-16:49:10] [V] [TRT] Tactic: 512 time 0.15872 [06/13/2021-16:49:10] [V] [TRT] Tactic: -32 time 0.205824 [06/13/2021-16:49:10] [V] [TRT] Tactic: -64 time 0.173056 [06/13/2021-16:49:10] [V] [TRT] Tactic: -128 time 0.164864 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 128 Time: 0.157696 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_51, Tanh_52), Mul_53), Add_54) (PointWiseV2) [06/13/2021-16:49:10] [V] [TRT] Tactic: 24 time 0.091136 [06/13/2021-16:49:10] [V] [TRT] Tactic: 25 time 0.08192 [06/13/2021-16:49:10] [V] [TRT] Tactic: 26 time 0.08192 [06/13/2021-16:49:10] [V] [TRT] Tactic: 27 time 0.083968 [06/13/2021-16:49:10] [V] [TRT] Tactic: 31 time 0.091136 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 25 Time: 0.08192 [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(64,8192,1,1048576) -> Float(64,8192,1,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(64,8192,1,1048576) -> Float(64,8192,1,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384:32,32768) -> Float(1,128,16384:32,32768) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(64,8192,1,1048576) -> Float(64,8192,1,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576), Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(64,8192,1,1048576), Float(64,8192,1,1048576) -> Float(64,8192,1,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384:32,32768), Float(1,128,16384:32,32768) -> Float(1,128,16384:32,32768) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,128,16384,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(64,8192,1,1048576) -> Float(64,8192,1,1048576) *************** [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,2097152) *************** [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_39, Tanh_40), Mul_41) (PointWise) [06/13/2021-16:49:10] [V] [TRT] Tactic: 128 time 0.155648 [06/13/2021-16:49:10] [V] [TRT] Tactic: 256 time 0.154624 [06/13/2021-16:49:10] [V] [TRT] Tactic: 512 time 0.154624 [06/13/2021-16:49:10] [V] [TRT] Tactic: -32 time 0.1792 [06/13/2021-16:49:10] [V] [TRT] Tactic: -64 time 0.149504 [06/13/2021-16:49:10] [V] [TRT] Tactic: -128 time 0.145408 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: -128 Time: 0.145408 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_39, Tanh_40), Mul_41) (PointWiseV2) [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.052224 [06/13/2021-16:49:10] [V] [TRT] Tactic: 1 time 0.045056 [06/13/2021-16:49:10] [V] [TRT] Tactic: 2 time 0.045056 [06/13/2021-16:49:10] [V] [TRT] Tactic: 3 time 0.045056 [06/13/2021-16:49:10] [V] [TRT] Tactic: 4 time 0.044032 [06/13/2021-16:49:10] [V] [TRT] Tactic: 5 time 0.044032 [06/13/2021-16:49:10] [V] [TRT] Tactic: 6 time 0.04608 [06/13/2021-16:49:10] [V] [TRT] Tactic: 7 time 0.045056 [06/13/2021-16:49:10] [V] [TRT] Tactic: 8 time 0.045056 [06/13/2021-16:49:10] [V] [TRT] Tactic: 9 time 0.044032 [06/13/2021-16:49:10] [V] [TRT] Tactic: 28 time 0.0512 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 4 Time: 0.044032 [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(128,16384,1,2097152) -> Float(128,16384,1,2097152) *************** [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_39, Tanh_40), Mul_41) (PointWise) [06/13/2021-16:49:10] [V] [TRT] Tactic: 128 time 0.155648 [06/13/2021-16:49:10] [V] [TRT] Tactic: 256 time 0.155648 [06/13/2021-16:49:10] [V] [TRT] Tactic: 512 time 0.155648 [06/13/2021-16:49:10] [V] [TRT] Tactic: -32 time 0.15872 [06/13/2021-16:49:10] [V] [TRT] Tactic: -64 time 0.166912 [06/13/2021-16:49:10] [V] [TRT] Tactic: -128 time 0.166912 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 128 Time: 0.155648 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_39, Tanh_40), Mul_41) (PointWiseV2) [06/13/2021-16:49:10] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384:32,65536) -> Float(1,128,16384:32,65536) *************** [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_39, Tanh_40), Mul_41) (PointWise) [06/13/2021-16:49:10] [V] [TRT] Tactic: 128 time 0.155648 [06/13/2021-16:49:10] [V] [TRT] Tactic: 256 time 0.155648 [06/13/2021-16:49:10] [V] [TRT] Tactic: 512 time 0.155648 [06/13/2021-16:49:10] [V] [TRT] Tactic: -32 time 0.1792 [06/13/2021-16:49:10] [V] [TRT] Tactic: -64 time 0.150528 [06/13/2021-16:49:10] [V] [TRT] Tactic: -128 time 0.145408 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: -128 Time: 0.145408 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_39, Tanh_40), Mul_41) (PointWiseV2) [06/13/2021-16:49:10] [V] [TRT] Tactic: 24 time 0.050176 [06/13/2021-16:49:10] [V] [TRT] Tactic: 25 time 0.0512 [06/13/2021-16:49:10] [V] [TRT] Tactic: 26 time 0.052224 [06/13/2021-16:49:10] [V] [TRT] Tactic: 27 time 0.05632 [06/13/2021-16:49:10] [V] [TRT] Tactic: 31 time 0.0512 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 24 Time: 0.050176 [06/13/2021-16:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:10] [V] [TRT] [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.0512 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.06656 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0512 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.08192 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.239616 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.08192 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.0512 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.089088 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.0512 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.093184 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.433152 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 1002 Time: 0.093184 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.131072 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.083968 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 0 Time: 0.083968 [06/13/2021-16:49:10] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:10] [V] [TRT] Tactic: 1002 time 0.089088 [06/13/2021-16:49:10] [V] [TRT] Tactic: 0 time 0.062464 [06/13/2021-16:49:10] [V] [TRT] Fastest Tactic: 0 Time: 0.062464 [06/13/2021-16:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,1048576) -> Float(1,128,16384,2097152) *************** [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_65, Tanh_66), Mul_67) (PointWise) [06/13/2021-16:49:11] [V] [TRT] Tactic: 128 time 0.155648 [06/13/2021-16:49:11] [V] [TRT] Tactic: 256 time 0.155648 [06/13/2021-16:49:11] [V] [TRT] Tactic: 512 time 0.155648 [06/13/2021-16:49:11] [V] [TRT] Tactic: -32 time 0.1792 [06/13/2021-16:49:11] [V] [TRT] Tactic: -64 time 0.150528 [06/13/2021-16:49:11] [V] [TRT] Tactic: -128 time 0.146432 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: -128 Time: 0.146432 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_65, Tanh_66), Mul_67) (PointWiseV2) [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.052224 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4 time 0.044032 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6 time 0.04608 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 8 time 0.044032 [06/13/2021-16:49:11] [V] [TRT] Tactic: 9 time 0.044032 [06/13/2021-16:49:11] [V] [TRT] Tactic: 28 time 0.050176 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 4 Time: 0.044032 [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(64,8192,1,1048576) -> Float(128,16384,1,2097152) *************** [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_65, Tanh_66), Mul_67) (PointWise) [06/13/2021-16:49:11] [V] [TRT] Tactic: 128 time 0.155648 [06/13/2021-16:49:11] [V] [TRT] Tactic: 256 time 0.155648 [06/13/2021-16:49:11] [V] [TRT] Tactic: 512 time 0.155648 [06/13/2021-16:49:11] [V] [TRT] Tactic: -32 time 0.15872 [06/13/2021-16:49:11] [V] [TRT] Tactic: -64 time 0.166912 [06/13/2021-16:49:11] [V] [TRT] Tactic: -128 time 0.166912 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 128 Time: 0.155648 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_65, Tanh_66), Mul_67) (PointWiseV2) [06/13/2021-16:49:11] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384:32,32768) -> Float(1,128,16384:32,65536) *************** [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_65, Tanh_66), Mul_67) (PointWise) [06/13/2021-16:49:11] [V] [TRT] Tactic: 128 time 0.154624 [06/13/2021-16:49:11] [V] [TRT] Tactic: 256 time 0.155648 [06/13/2021-16:49:11] [V] [TRT] Tactic: 512 time 0.154624 [06/13/2021-16:49:11] [V] [TRT] Tactic: -32 time 0.178176 [06/13/2021-16:49:11] [V] [TRT] Tactic: -64 time 0.150528 [06/13/2021-16:49:11] [V] [TRT] Tactic: -128 time 0.145408 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: -128 Time: 0.145408 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_65, Tanh_66), Mul_67) (PointWiseV2) [06/13/2021-16:49:11] [V] [TRT] Tactic: 24 time 0.0512 [06/13/2021-16:49:11] [V] [TRT] Tactic: 25 time 0.0512 [06/13/2021-16:49:11] [V] [TRT] Tactic: 26 time 0.052224 [06/13/2021-16:49:11] [V] [TRT] Tactic: 27 time 0.057344 [06/13/2021-16:49:11] [V] [TRT] Tactic: 31 time 0.052224 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 24 Time: 0.0512 [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,2097152) *************** [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(128,16384,1,2097152) -> Float(128,16384,1,2097152) *************** [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,128,16384,2097152) *************** [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(128,16384,1,2097152) -> Float(128,16384,1,2097152) *************** [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384:32,65536) -> Float(1,128,16384:32,65536) *************** [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,128,16384,2097152) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_73 (FusedConvActConvolution) [06/13/2021-16:49:11] [V] [TRT] Tactic: 458751 time 0.703488 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 458751 Time: 0.703488 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_73 (CaskConvolution) [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1062367460111450758 time 0.560192 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1754984623894446479 time 0.64 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3611739942397549984 time 0.496864 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4337000649858996379 time 0.498688 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4501471010995462441 time 0.490496 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5137655947464784826 time 0.477184 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5288347012147084929 time 0.487424 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6645123197870846056 time 0.490496 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7144526460361122478 time 0.62464 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -9137461792520977713 time 0.498688 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: -8262349710178828730 time 0.494592 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: -8133971918129952780 time 0.572416 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -6092040395344634144 time 0.580608 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: -4787320710726427159 time 0.643072 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -3456450830548107839 time 0.52224 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: -1218658103698133241 time 0.56832 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: -836875257600482091 time 0.587776 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -410470605513481746 time 0.480256 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.477184 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_73 (CudaConvolution) [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.825344 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1 time 0.5888 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2 time 0.787456 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5 time 17.9732 [06/13/2021-16:49:11] [V] [TRT] Tactic: 56 time 0.82432 [06/13/2021-16:49:11] [V] [TRT] Tactic: 57 time 0.589824 [06/13/2021-16:49:11] [V] [TRT] Tactic: 58 time 0.784384 [06/13/2021-16:49:11] [V] [TRT] Tactic: 61 time 17.9997 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1 Time: 0.5888 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_73 (CudaDepthwiseConvolution) [06/13/2021-16:49:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_73 (CublasConvolution) [06/13/2021-16:49:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(128,16384,1,2097152) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_73 (FusedConvActConvolution) [06/13/2021-16:49:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_73 (CaskConvolution) [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -9153228964338181824 time 0.442368 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -7394439838318485025 time 0.427008 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.427008 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_73 (CudaConvolution) [06/13/2021-16:49:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_73 (CudaDepthwiseConvolution) [06/13/2021-16:49:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_73 (CublasConvolution) [06/13/2021-16:49:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.052224 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.06144 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.052224 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.078848 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.08704 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.078848 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.050176 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.08192 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.050176 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.095232 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.125952 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.095232 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.123904 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.065536 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 0 Time: 0.065536 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.091136 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.062464 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 0 Time: 0.062464 [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_74, Tanh_75), Mul_76) (PointWise) [06/13/2021-16:49:11] [V] [TRT] Tactic: 128 time 0.137216 [06/13/2021-16:49:11] [V] [TRT] Tactic: 256 time 0.137216 [06/13/2021-16:49:11] [V] [TRT] Tactic: 512 time 0.13824 [06/13/2021-16:49:11] [V] [TRT] Tactic: -32 time 0.178176 [06/13/2021-16:49:11] [V] [TRT] Tactic: -64 time 0.14848 [06/13/2021-16:49:11] [V] [TRT] Tactic: -128 time 0.14336 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 128 Time: 0.137216 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_74, Tanh_75), Mul_76) (PointWiseV2) [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4 time 0.044032 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5 time 0.044032 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 8 time 0.044032 [06/13/2021-16:49:11] [V] [TRT] Tactic: 9 time 0.044032 [06/13/2021-16:49:11] [V] [TRT] Tactic: 28 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 4 Time: 0.044032 [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_74, Tanh_75), Mul_76) (PointWise) [06/13/2021-16:49:11] [V] [TRT] Tactic: 128 time 0.137216 [06/13/2021-16:49:11] [V] [TRT] Tactic: 256 time 0.137216 [06/13/2021-16:49:11] [V] [TRT] Tactic: 512 time 0.13824 [06/13/2021-16:49:11] [V] [TRT] Tactic: -32 time 0.178176 [06/13/2021-16:49:11] [V] [TRT] Tactic: -64 time 0.150528 [06/13/2021-16:49:11] [V] [TRT] Tactic: -128 time 0.144384 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 128 Time: 0.137216 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_74, Tanh_75), Mul_76) (PointWiseV2) [06/13/2021-16:49:11] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,32768) -> Float(1,64,4096:32,32768) *************** [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_74, Tanh_75), Mul_76) (PointWise) [06/13/2021-16:49:11] [V] [TRT] Tactic: 128 time 0.137216 [06/13/2021-16:49:11] [V] [TRT] Tactic: 256 time 0.137216 [06/13/2021-16:49:11] [V] [TRT] Tactic: 512 time 0.13824 [06/13/2021-16:49:11] [V] [TRT] Tactic: -32 time 0.178176 [06/13/2021-16:49:11] [V] [TRT] Tactic: -64 time 0.149504 [06/13/2021-16:49:11] [V] [TRT] Tactic: -128 time 0.14336 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 128 Time: 0.137216 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_74, Tanh_75), Mul_76) (PointWiseV2) [06/13/2021-16:49:11] [V] [TRT] Tactic: 24 time 0.050176 [06/13/2021-16:49:11] [V] [TRT] Tactic: 25 time 0.0512 [06/13/2021-16:49:11] [V] [TRT] Tactic: 26 time 0.052224 [06/13/2021-16:49:11] [V] [TRT] Tactic: 27 time 0.057344 [06/13/2021-16:49:11] [V] [TRT] Tactic: 31 time 0.050176 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 24 Time: 0.050176 [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_77 || Conv_81 (FusedConvActConvolution) [06/13/2021-16:49:11] [V] [TRT] Tactic: 589823 time 0.364544 [06/13/2021-16:49:11] [V] [TRT] Tactic: 655359 time 0.24064 [06/13/2021-16:49:11] [V] [TRT] Tactic: 786431 time 0.29696 [06/13/2021-16:49:11] [V] [TRT] Tactic: 851967 time 0.264192 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1179647 time 0.241664 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1310719 time 1.05472 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1376255 time 0.249856 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1441791 time 0.37376 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1507327 time 0.253952 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1638399 time 0.321536 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1835007 time 0.294912 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1900543 time 0.289792 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2097151 time 0.328704 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2162687 time 0.259072 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2293759 time 0.258048 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2359295 time 0.236544 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2686975 time 0.256 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3080191 time 0.260096 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3342335 time 0.253952 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3407871 time 0.22528 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3538943 time 0.218112 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3670015 time 0.294912 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3932159 time 0.270336 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3997695 time 0.279552 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4063231 time 0.270336 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4194303 time 0.304128 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4259839 time 0.304128 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4325375 time 0.293888 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4521983 time 0.3072 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4587519 time 0.293888 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4653055 time 0.260096 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4915199 time 0.287744 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4980735 time 0.313344 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5177343 time 0.241664 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5242879 time 0.253952 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5373951 time 0.29184 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5439487 time 0.487424 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5570559 time 0.265216 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5636095 time 0.269312 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5701631 time 0.259072 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5767167 time 1.29843 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5832703 time 0.217088 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5898239 time 0.227328 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6029311 time 0.284672 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6225919 time 0.24064 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6291455 time 0.241664 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6422527 time 0.25088 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6750207 time 0.320512 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6815743 time 0.362496 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6946815 time 0.421888 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7012351 time 0.328704 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7077887 time 0.20992 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7143423 time 0.493568 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7208959 time 0.232448 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7340031 time 0.22528 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7405567 time 0.264192 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7536639 time 0.418816 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7602175 time 0.318464 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7733247 time 0.216064 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7798783 time 0.295936 [06/13/2021-16:49:11] [V] [TRT] Tactic: 8191999 time 0.41472 [06/13/2021-16:49:11] [V] [TRT] Tactic: 8257535 time 0.287744 [06/13/2021-16:49:11] [V] [TRT] Tactic: 8323071 time 0.33792 [06/13/2021-16:49:11] [V] [TRT] Tactic: 8650751 time 0.339968 [06/13/2021-16:49:11] [V] [TRT] Tactic: 8716287 time 0.336896 [06/13/2021-16:49:11] [V] [TRT] Tactic: 9109503 time 0.326656 [06/13/2021-16:49:11] [V] [TRT] Tactic: 9568255 time 0.28672 [06/13/2021-16:49:11] [V] [TRT] Tactic: 9895935 time 0.306176 [06/13/2021-16:49:11] [V] [TRT] Tactic: 10223615 time 0.252928 [06/13/2021-16:49:11] [V] [TRT] Tactic: 10354687 time 0.283648 [06/13/2021-16:49:11] [V] [TRT] Tactic: 10551295 time 0.34304 [06/13/2021-16:49:11] [V] [TRT] Tactic: 10747903 time 0.21504 [06/13/2021-16:49:11] [V] [TRT] Tactic: 10944511 time 0.313344 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 7077887 Time: 0.20992 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_77 || Conv_81 (CaskConvolution) [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1062367460111450758 time 0.156672 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1698681053543049347 time 0.13824 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4501471010995462441 time 0.131072 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5137655947464784826 time 0.126976 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5288347012147084929 time 0.131072 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5326823351883942011 time 0.125984 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5500448035057547314 time 0.144384 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6645123197870846056 time 0.13312 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7144526460361122478 time 0.173056 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: -8262349710178828730 time 0.13312 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -6576203419454146580 time 0.151552 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: -4787320710726427159 time 0.176128 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -3456450830548107839 time 0.155648 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: -1218658103698133241 time 0.152576 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: -836875257600482091 time 0.147456 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -410470605513481746 time 0.129024 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Tactic: -377491875521947884 time 0.129024 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -37215280111360163 time 0.123904 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.123904 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_77 || Conv_81 (CudaConvolution) [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.29696 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1 time 0.173056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2 time 0.365568 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2223505408, available: 524288000 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5 time 0.429056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 56 time 0.297984 [06/13/2021-16:49:11] [V] [TRT] Tactic: 57 time 0.173056 [06/13/2021-16:49:11] [V] [TRT] Tactic: 58 time 0.364544 [06/13/2021-16:49:11] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2223505408, available: 524288000 [06/13/2021-16:49:11] [V] [TRT] Tactic: 61 time 0.425984 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1 Time: 0.173056 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_77 || Conv_81 (CudaDepthwiseConvolution) [06/13/2021-16:49:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_77 || Conv_81 (CublasConvolution) [06/13/2021-16:49:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_77 || Conv_81 (FusedConvActConvolution) [06/13/2021-16:49:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_77 || Conv_81 (CaskConvolution) [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3886731678879822788 time 0.111616 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6629944304117643200 time 0.128 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -9153228964338181824 time 0.129024 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Tactic: -7394439838318485025 time 0.11264 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.111616 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_77 || Conv_81 (CudaConvolution) [06/13/2021-16:49:11] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_77 || Conv_81 (CudaDepthwiseConvolution) [06/13/2021-16:49:11] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_77 || Conv_81 (CublasConvolution) [06/13/2021-16:49:11] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.052224 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.06144 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.052224 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.078848 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.086016 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.078848 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.052224 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.080896 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.052224 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.095232 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.124928 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.095232 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.029696 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.029696 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.043264 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.04608 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.043264 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.029696 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.043008 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.029696 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.049152 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.063488 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.049152 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.064512 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.034816 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 0 Time: 0.034816 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.048128 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.033792 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 0 Time: 0.033792 [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_82, Tanh_83), Mul_84) (PointWise) [06/13/2021-16:49:11] [V] [TRT] Tactic: 128 time 0.079872 [06/13/2021-16:49:11] [V] [TRT] Tactic: 256 time 0.079872 [06/13/2021-16:49:11] [V] [TRT] Tactic: 512 time 0.079872 [06/13/2021-16:49:11] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:11] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:11] [V] [TRT] Tactic: -128 time 0.077824 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: -128 Time: 0.077824 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_82, Tanh_83), Mul_84) (PointWiseV2) [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.027648 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1 time 0.023552 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2 time 0.023552 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3 time 0.024576 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4 time 0.023552 [06/13/2021-16:49:11] [V] [TRT] Tactic: 5 time 0.022528 [06/13/2021-16:49:11] [V] [TRT] Tactic: 6 time 0.0256 [06/13/2021-16:49:11] [V] [TRT] Tactic: 7 time 0.023552 [06/13/2021-16:49:11] [V] [TRT] Tactic: 8 time 0.023552 [06/13/2021-16:49:11] [V] [TRT] Tactic: 9 time 0.024576 [06/13/2021-16:49:11] [V] [TRT] Tactic: 28 time 0.026624 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 5 Time: 0.022528 [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_82, Tanh_83), Mul_84) (PointWise) [06/13/2021-16:49:11] [V] [TRT] Tactic: 128 time 0.079872 [06/13/2021-16:49:11] [V] [TRT] Tactic: 256 time 0.079872 [06/13/2021-16:49:11] [V] [TRT] Tactic: 512 time 0.079872 [06/13/2021-16:49:11] [V] [TRT] Tactic: -32 time 0.079872 [06/13/2021-16:49:11] [V] [TRT] Tactic: -64 time 0.078848 [06/13/2021-16:49:11] [V] [TRT] Tactic: -128 time 0.086016 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: -64 Time: 0.078848 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_82, Tanh_83), Mul_84) (PointWiseV2) [06/13/2021-16:49:11] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: -64 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,32768) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_82, Tanh_83), Mul_84) (PointWise) [06/13/2021-16:49:11] [V] [TRT] Tactic: 128 time 0.079872 [06/13/2021-16:49:11] [V] [TRT] Tactic: 256 time 0.079872 [06/13/2021-16:49:11] [V] [TRT] Tactic: 512 time 0.079872 [06/13/2021-16:49:11] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:11] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:11] [V] [TRT] Tactic: -128 time 0.078848 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: -128 Time: 0.078848 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_82, Tanh_83), Mul_84) (PointWiseV2) [06/13/2021-16:49:11] [V] [TRT] Tactic: 24 time 0.026624 [06/13/2021-16:49:11] [V] [TRT] Tactic: 25 time 0.027648 [06/13/2021-16:49:11] [V] [TRT] Tactic: 26 time 0.029696 [06/13/2021-16:49:11] [V] [TRT] Tactic: 27 time 0.026624 [06/13/2021-16:49:11] [V] [TRT] Tactic: 31 time 0.026656 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 24 Time: 0.026624 [06/13/2021-16:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:11] [V] [TRT] [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.029696 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.029696 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.044032 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.045056 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.044032 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.034016 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.028672 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.050176 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.06144 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.050176 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.065536 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.034816 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 0 Time: 0.034816 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.047104 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.033792 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 0 Time: 0.033792 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.029696 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.029696 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.029696 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.034816 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 1002 Time: 0.029696 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.064512 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.034816 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 0 Time: 0.034816 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:11] [V] [TRT] Tactic: 1002 time 0.048128 [06/13/2021-16:49:11] [V] [TRT] Tactic: 0 time 0.033792 [06/13/2021-16:49:11] [V] [TRT] Fastest Tactic: 0 Time: 0.033792 [06/13/2021-16:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:11] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:11] [V] [TRT] --------------- Timing Runner: Conv_85 (FusedConvActConvolution) [06/13/2021-16:49:11] [V] [TRT] Tactic: 589823 time 0.140288 [06/13/2021-16:49:11] [V] [TRT] Tactic: 655359 time 0.098304 [06/13/2021-16:49:11] [V] [TRT] Tactic: 786431 time 0.10752 [06/13/2021-16:49:11] [V] [TRT] Tactic: 851967 time 0.093184 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1179647 time 0.086016 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1310719 time 0.349184 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1376255 time 0.103424 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1441791 time 0.124928 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1507327 time 0.096256 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1638399 time 0.111616 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1835007 time 0.106496 [06/13/2021-16:49:11] [V] [TRT] Tactic: 1900543 time 0.100352 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2097151 time 0.113664 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2162687 time 0.105472 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2293759 time 0.103424 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2359295 time 0.089088 [06/13/2021-16:49:11] [V] [TRT] Tactic: 2686975 time 0.1024 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3080191 time 0.093184 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3342335 time 0.095232 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3407871 time 0.088064 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3538943 time 0.080896 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3670015 time 0.104448 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3932159 time 0.094208 [06/13/2021-16:49:11] [V] [TRT] Tactic: 3997695 time 0.1024 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4063231 time 0.095232 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4194303 time 0.110592 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4259839 time 0.105472 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4325375 time 0.103424 [06/13/2021-16:49:11] [V] [TRT] Tactic: 4521983 time 0.114688 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4587519 time 0.103424 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4653055 time 0.093184 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4915199 time 0.1024 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4980735 time 0.11264 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5177343 time 0.08704 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5242879 time 0.090112 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5373951 time 0.101376 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5439487 time 0.169984 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5570559 time 0.096256 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5636095 time 0.096256 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5701631 time 0.1024 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5767167 time 0.369664 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5832703 time 0.082944 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5898239 time 0.08192 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6029311 time 0.103424 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6225919 time 0.08704 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6291455 time 0.086016 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6422527 time 0.089088 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6750207 time 0.110592 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6815743 time 0.114688 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6946815 time 0.140288 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7012351 time 0.114688 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7077887 time 0.0768 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7143423 time 0.157696 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7208959 time 0.089088 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7340031 time 0.08192 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7405567 time 0.091136 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7536639 time 0.124928 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7602175 time 0.109568 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7733247 time 0.080896 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7798783 time 0.108544 [06/13/2021-16:49:12] [V] [TRT] Tactic: 8191999 time 0.129024 [06/13/2021-16:49:12] [V] [TRT] Tactic: 8257535 time 0.104448 [06/13/2021-16:49:12] [V] [TRT] Tactic: 8323071 time 0.115712 [06/13/2021-16:49:12] [V] [TRT] Tactic: 8650751 time 0.11776 [06/13/2021-16:49:12] [V] [TRT] Tactic: 8716287 time 0.119808 [06/13/2021-16:49:12] [V] [TRT] Tactic: 9109503 time 0.113664 [06/13/2021-16:49:12] [V] [TRT] Tactic: 9568255 time 0.101376 [06/13/2021-16:49:12] [V] [TRT] Tactic: 9895935 time 0.111616 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10223615 time 0.1024 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10354687 time 0.1024 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10551295 time 0.118784 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10747903 time 0.079872 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10944511 time 0.110592 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 7077887 Time: 0.0768 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_85 (CaskConvolution) [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1062367460111450758 time 0.0512 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1698681053543049347 time 0.0512 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4501471010995462441 time 0.047104 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5137655947464784826 time 0.044032 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5288347012147084929 time 0.047104 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5326823351883942011 time 0.045056 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5500448035057547314 time 0.053248 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6645123197870846056 time 0.045312 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7144526460361122478 time 0.052224 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -8262349710178828730 time 0.048128 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -6576203419454146580 time 0.048128 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -4787320710726427159 time 0.053248 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -3456450830548107839 time 0.049152 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -1218658103698133241 time 0.055296 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -836875257600482091 time 0.054272 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -410470605513481746 time 0.04608 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -377491875521947884 time 0.04608 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -37215280111360163 time 0.044032 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.044032 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_85 (CudaConvolution) [06/13/2021-16:49:12] [V] [TRT] Tactic: 0 time 0.095232 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1 time 0.06656 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2 time 0.13824 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4 skipped. Scratch requested: 558039040, available: 524288000 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5 time 0.160768 [06/13/2021-16:49:12] [V] [TRT] Tactic: 56 time 0.095232 [06/13/2021-16:49:12] [V] [TRT] Tactic: 57 time 0.067584 [06/13/2021-16:49:12] [V] [TRT] Tactic: 58 time 0.137216 [06/13/2021-16:49:12] [V] [TRT] Tactic: 60 skipped. Scratch requested: 558039040, available: 524288000 [06/13/2021-16:49:12] [V] [TRT] Tactic: 61 time 0.164864 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 1 Time: 0.06656 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_85 (CudaDepthwiseConvolution) [06/13/2021-16:49:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_85 (CublasConvolution) [06/13/2021-16:49:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_85 (FusedConvActConvolution) [06/13/2021-16:49:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_85 (CaskConvolution) [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 3886731678879822788 time 0.041984 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6629944304117643200 time 0.050176 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -9153228964338181824 time 0.050176 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -7394439838318485025 time 0.043008 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.041984 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_85 (CudaConvolution) [06/13/2021-16:49:12] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_85 (CudaDepthwiseConvolution) [06/13/2021-16:49:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_85 (CublasConvolution) [06/13/2021-16:49:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:12] [V] [TRT] Tactic: 1002 time 0.044032 [06/13/2021-16:49:12] [V] [TRT] Tactic: 0 time 0.045056 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.044032 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:12] [V] [TRT] Tactic: 1002 time 0.049152 [06/13/2021-16:49:12] [V] [TRT] Tactic: 0 time 0.06144 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 1002 Time: 0.049152 [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_86, Tanh_87), Mul_88) (PointWise) [06/13/2021-16:49:12] [V] [TRT] Tactic: 128 time 0.070656 [06/13/2021-16:49:12] [V] [TRT] Tactic: 256 time 0.070656 [06/13/2021-16:49:12] [V] [TRT] Tactic: 512 time 0.070656 [06/13/2021-16:49:12] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:12] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:12] [V] [TRT] Tactic: -128 time 0.0768 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 128 Time: 0.070656 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_86, Tanh_87), Mul_88) (PointWiseV2) [06/13/2021-16:49:12] [V] [TRT] Tactic: 0 time 0.0256 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1 time 0.023552 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2 time 0.023552 [06/13/2021-16:49:12] [V] [TRT] Tactic: 3 time 0.024576 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4 time 0.023552 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5 time 0.023552 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6 time 0.0256 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7 time 0.024576 [06/13/2021-16:49:12] [V] [TRT] Tactic: 8 time 0.023552 [06/13/2021-16:49:12] [V] [TRT] Tactic: 9 time 0.023552 [06/13/2021-16:49:12] [V] [TRT] Tactic: 28 time 0.024576 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 1 Time: 0.023552 [06/13/2021-16:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [06/13/2021-16:49:12] [V] [TRT] [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_86, Tanh_87), Mul_88) (PointWise) [06/13/2021-16:49:12] [V] [TRT] Tactic: 128 time 0.070656 [06/13/2021-16:49:12] [V] [TRT] Tactic: 256 time 0.070656 [06/13/2021-16:49:12] [V] [TRT] Tactic: 512 time 0.070784 [06/13/2021-16:49:12] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:12] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:12] [V] [TRT] Tactic: -128 time 0.0768 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 128 Time: 0.070656 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_86, Tanh_87), Mul_88) (PointWiseV2) [06/13/2021-16:49:12] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:12] [V] [TRT] [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_86, Tanh_87), Mul_88) (PointWise) [06/13/2021-16:49:12] [V] [TRT] Tactic: 128 time 0.070656 [06/13/2021-16:49:12] [V] [TRT] Tactic: 256 time 0.070656 [06/13/2021-16:49:12] [V] [TRT] Tactic: 512 time 0.07168 [06/13/2021-16:49:12] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:12] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:12] [V] [TRT] Tactic: -128 time 0.077824 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 128 Time: 0.070656 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_86, Tanh_87), Mul_88) (PointWiseV2) [06/13/2021-16:49:12] [V] [TRT] Tactic: 24 time 0.026624 [06/13/2021-16:49:12] [V] [TRT] Tactic: 25 time 0.026624 [06/13/2021-16:49:12] [V] [TRT] Tactic: 26 time 0.029696 [06/13/2021-16:49:12] [V] [TRT] Tactic: 27 time 0.026624 [06/13/2021-16:49:12] [V] [TRT] Tactic: 31 time 0.026624 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 24 Time: 0.026624 [06/13/2021-16:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:12] [V] [TRT] [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_89 (FusedConvActConvolution) [06/13/2021-16:49:12] [V] [TRT] Tactic: 524287 time 0.285696 [06/13/2021-16:49:12] [V] [TRT] Tactic: 720895 time 0.25088 [06/13/2021-16:49:12] [V] [TRT] Tactic: 983039 time 0.246784 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1048575 time 0.258048 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1703935 time 0.24576 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1769471 time 0.334848 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1966079 time 0.28672 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2031615 time 0.263168 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2228223 time 0.280576 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2424831 time 0.406528 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2621439 time 0.253952 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2752511 time 0.299008 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2818047 time 0.390144 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2883583 time 0.31744 [06/13/2021-16:49:12] [V] [TRT] Tactic: 3014655 time 0.258048 [06/13/2021-16:49:12] [V] [TRT] Tactic: 3145727 time 0.26112 [06/13/2021-16:49:12] [V] [TRT] Tactic: 3473407 time 0.284672 [06/13/2021-16:49:12] [V] [TRT] Tactic: 3604479 time 0.253952 [06/13/2021-16:49:12] [V] [TRT] Tactic: 3735551 time 0.253952 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4390911 time 0.320512 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5046271 time 0.270336 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5963775 time 0.283648 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6160383 time 0.29184 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6488063 time 0.297984 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6881279 time 0.290816 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7274495 time 0.294912 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7864319 time 0.300032 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7995391 time 0.248832 [06/13/2021-16:49:12] [V] [TRT] Tactic: 8585215 time 0.292864 [06/13/2021-16:49:12] [V] [TRT] Tactic: 8847359 time 0.309248 [06/13/2021-16:49:12] [V] [TRT] Tactic: 8978431 time 0.294912 [06/13/2021-16:49:12] [V] [TRT] Tactic: 9043967 time 0.280576 [06/13/2021-16:49:12] [V] [TRT] Tactic: 9175039 time 0.251904 [06/13/2021-16:49:12] [V] [TRT] Tactic: 9502719 time 0.326656 [06/13/2021-16:49:12] [V] [TRT] Tactic: 9830399 time 0.25088 [06/13/2021-16:49:12] [V] [TRT] Tactic: 9961471 time 0.284672 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10027007 time 0.265216 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10092543 time 0.32256 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10289151 time 0.285696 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10485759 time 0.257024 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10682367 time 0.252928 [06/13/2021-16:49:12] [V] [TRT] Tactic: 10813439 time 0.24064 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 10813439 Time: 0.24064 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_89 (CaskConvolution) [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1062367460111450758 time 0.325632 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1754984623894446479 time 0.3072 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: 3611739942397549984 time 0.300032 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 3827454225649558724 time 0.12288 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4337000649858996379 time 0.294912 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4501471010995462441 time 0.299008 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5137655947464784826 time 0.275456 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5288347012147084929 time 0.29696 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5921334924264294896 time 0.129248 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6645123197870846056 time 0.28672 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7144526460361122478 time 0.301056 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7852627285308570038 time 0.134144 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -9137461792520977713 time 0.3072 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -8776506421218919509 time 0.12288 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -8262349710178828730 time 0.30208 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -8133971918129952780 time 0.346112 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -6092040395344634144 time 0.350208 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -4787320710726427159 time 0.3072 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -3456450830548107839 time 0.299008 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -2318106587342035239 time 0.129024 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -1343271414618805657 time 0.123904 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -1218658103698133241 time 0.344064 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Tactic: -836875257600482091 time 0.328704 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -410470605513481746 time 0.290816 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 3827454225649558724 Time: 0.12288 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaConvolution) [06/13/2021-16:49:12] [V] [TRT] Tactic: 0 time 0.531456 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1 time 0.319488 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2 time 0.550912 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2198667264, available: 524288000 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5 time 3.59523 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6 time 0.154624 [06/13/2021-16:49:12] [V] [TRT] Tactic: 56 time 0.52736 [06/13/2021-16:49:12] [V] [TRT] Tactic: 57 time 0.32256 [06/13/2021-16:49:12] [V] [TRT] Tactic: 58 time 0.55808 [06/13/2021-16:49:12] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2198667264, available: 524288000 [06/13/2021-16:49:12] [V] [TRT] Tactic: 61 time 3.59117 [06/13/2021-16:49:12] [V] [TRT] Tactic: 62 time 0.1536 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 62 Time: 0.1536 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaDepthwiseConvolution) [06/13/2021-16:49:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_89 (CublasConvolution) [06/13/2021-16:49:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3827454225649558724 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:12] [V] [TRT] [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_89 (FusedConvActConvolution) [06/13/2021-16:49:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_89 (CaskConvolution) [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -9153228964338181824 time 0.224256 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Tactic: -7394439838318485025 time 0.237568 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.224256 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaConvolution) [06/13/2021-16:49:12] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_89 (CudaDepthwiseConvolution) [06/13/2021-16:49:12] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: Conv_89 (CublasConvolution) [06/13/2021-16:49:12] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] Conv_89 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_90, Tanh_91), Mul_92), Add_93) (PointWise) [06/13/2021-16:49:12] [V] [TRT] Tactic: 128 time 0.080896 [06/13/2021-16:49:12] [V] [TRT] Tactic: 256 time 0.08192 [06/13/2021-16:49:12] [V] [TRT] Tactic: 512 time 0.08192 [06/13/2021-16:49:12] [V] [TRT] Tactic: -32 time 0.130048 [06/13/2021-16:49:12] [V] [TRT] Tactic: -64 time 0.09216 [06/13/2021-16:49:12] [V] [TRT] Tactic: -128 time 0.089088 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 128 Time: 0.080896 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_90, Tanh_91), Mul_92), Add_93) (PointWiseV2) [06/13/2021-16:49:12] [V] [TRT] Tactic: 0 time 0.033792 [06/13/2021-16:49:12] [V] [TRT] Tactic: 1 time 0.033792 [06/13/2021-16:49:12] [V] [TRT] Tactic: 2 time 0.033792 [06/13/2021-16:49:12] [V] [TRT] Tactic: 3 time 0.033792 [06/13/2021-16:49:12] [V] [TRT] Tactic: 4 time 0.032768 [06/13/2021-16:49:12] [V] [TRT] Tactic: 5 time 0.032768 [06/13/2021-16:49:12] [V] [TRT] Tactic: 6 time 0.034816 [06/13/2021-16:49:12] [V] [TRT] Tactic: 7 time 0.033792 [06/13/2021-16:49:12] [V] [TRT] Tactic: 8 time 0.033792 [06/13/2021-16:49:12] [V] [TRT] Tactic: 9 time 0.032768 [06/13/2021-16:49:12] [V] [TRT] Tactic: 28 time 0.033792 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 4 Time: 0.032768 [06/13/2021-16:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [06/13/2021-16:49:12] [V] [TRT] [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288), Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_90, Tanh_91), Mul_92), Add_93) (PointWise) [06/13/2021-16:49:12] [V] [TRT] Tactic: 128 time 0.080896 [06/13/2021-16:49:12] [V] [TRT] Tactic: 256 time 0.080896 [06/13/2021-16:49:12] [V] [TRT] Tactic: 512 time 0.08192 [06/13/2021-16:49:12] [V] [TRT] Tactic: -32 time 0.130048 [06/13/2021-16:49:12] [V] [TRT] Tactic: -64 time 0.09216 [06/13/2021-16:49:12] [V] [TRT] Tactic: -128 time 0.089088 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 128 Time: 0.080896 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_90, Tanh_91), Mul_92), Add_93) (PointWiseV2) [06/13/2021-16:49:12] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:12] [V] [TRT] [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384), Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_90, Tanh_91), Mul_92), Add_93) (PointWise) [06/13/2021-16:49:12] [V] [TRT] Tactic: 128 time 0.080896 [06/13/2021-16:49:12] [V] [TRT] Tactic: 256 time 0.08192 [06/13/2021-16:49:12] [V] [TRT] Tactic: 512 time 0.08192 [06/13/2021-16:49:12] [V] [TRT] Tactic: -32 time 0.130048 [06/13/2021-16:49:12] [V] [TRT] Tactic: -64 time 0.093184 [06/13/2021-16:49:12] [V] [TRT] Tactic: -128 time 0.089088 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 128 Time: 0.080896 [06/13/2021-16:49:12] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_90, Tanh_91), Mul_92), Add_93) (PointWiseV2) [06/13/2021-16:49:12] [V] [TRT] Tactic: 24 time 0.048128 [06/13/2021-16:49:12] [V] [TRT] Tactic: 25 time 0.041984 [06/13/2021-16:49:12] [V] [TRT] Tactic: 26 time 0.043008 [06/13/2021-16:49:12] [V] [TRT] Tactic: 27 time 0.038912 [06/13/2021-16:49:12] [V] [TRT] Tactic: 31 time 0.047104 [06/13/2021-16:49:12] [V] [TRT] Fastest Tactic: 27 Time: 0.038912 [06/13/2021-16:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [06/13/2021-16:49:12] [V] [TRT] [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288), Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384), Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288), Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384), Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288), Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384), Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288), Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384), Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288), Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384), Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288), Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384), Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288), Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288), Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384), Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_78, Tanh_79), Mul_80) (PointWise) [06/13/2021-16:49:13] [V] [TRT] Tactic: 128 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 256 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 512 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:13] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:13] [V] [TRT] Tactic: -128 time 0.077824 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: -128 Time: 0.077824 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_78, Tanh_79), Mul_80) (PointWiseV2) [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.027648 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1 time 0.024576 [06/13/2021-16:49:13] [V] [TRT] Tactic: 2 time 0.023552 [06/13/2021-16:49:13] [V] [TRT] Tactic: 3 time 0.024576 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4 time 0.023552 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5 time 0.023552 [06/13/2021-16:49:13] [V] [TRT] Tactic: 6 time 0.0256 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7 time 0.024576 [06/13/2021-16:49:13] [V] [TRT] Tactic: 8 time 0.024576 [06/13/2021-16:49:13] [V] [TRT] Tactic: 9 time 0.022528 [06/13/2021-16:49:13] [V] [TRT] Tactic: 28 time 0.027648 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 9 Time: 0.022528 [06/13/2021-16:49:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [06/13/2021-16:49:13] [V] [TRT] [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_78, Tanh_79), Mul_80) (PointWise) [06/13/2021-16:49:13] [V] [TRT] Tactic: 128 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 256 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 512 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: -32 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: -64 time 0.078848 [06/13/2021-16:49:13] [V] [TRT] Tactic: -128 time 0.084992 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: -64 Time: 0.078848 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_78, Tanh_79), Mul_80) (PointWiseV2) [06/13/2021-16:49:13] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: -64 [06/13/2021-16:49:13] [V] [TRT] [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,32768) -> Float(1,64,4096:32,32768) *************** [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_78, Tanh_79), Mul_80) (PointWise) [06/13/2021-16:49:13] [V] [TRT] Tactic: 128 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 256 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 512 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:13] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:13] [V] [TRT] Tactic: -128 time 0.078848 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: -128 Time: 0.078848 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_78, Tanh_79), Mul_80) (PointWiseV2) [06/13/2021-16:49:13] [V] [TRT] Tactic: 24 time 0.027648 [06/13/2021-16:49:13] [V] [TRT] Tactic: 25 time 0.028672 [06/13/2021-16:49:13] [V] [TRT] Tactic: 26 time 0.028672 [06/13/2021-16:49:13] [V] [TRT] Tactic: 27 time 0.026624 [06/13/2021-16:49:13] [V] [TRT] Tactic: 31 time 0.026624 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 27 Time: 0.026624 [06/13/2021-16:49:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [06/13/2021-16:49:13] [V] [TRT] [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:13] [V] [TRT] Tactic: 1002 time 0.029696 [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.029696 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:13] [V] [TRT] Tactic: 1002 time 0.044032 [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.04608 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.044032 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:13] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.034816 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.028672 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:13] [V] [TRT] Tactic: 1002 time 0.0512 [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.060416 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 1002 Time: 0.0512 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:13] [V] [TRT] Tactic: 1002 time 0.064512 [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.034816 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 0 Time: 0.034816 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:13] [V] [TRT] Tactic: 1002 time 0.048128 [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.033792 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 0 Time: 0.033792 [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_158, Tanh_159), Mul_160) (PointWise) [06/13/2021-16:49:13] [V] [TRT] Tactic: 128 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 256 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 512 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:13] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:13] [V] [TRT] Tactic: -128 time 0.077824 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: -128 Time: 0.077824 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_158, Tanh_159), Mul_160) (PointWiseV2) [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.028672 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1 time 0.024576 [06/13/2021-16:49:13] [V] [TRT] Tactic: 2 time 0.023552 [06/13/2021-16:49:13] [V] [TRT] Tactic: 3 time 0.024576 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4 time 0.023552 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5 time 0.023552 [06/13/2021-16:49:13] [V] [TRT] Tactic: 6 time 0.0256 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7 time 0.024576 [06/13/2021-16:49:13] [V] [TRT] Tactic: 8 time 0.023552 [06/13/2021-16:49:13] [V] [TRT] Tactic: 9 time 0.023552 [06/13/2021-16:49:13] [V] [TRT] Tactic: 28 time 0.027648 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 2 Time: 0.023552 [06/13/2021-16:49:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [06/13/2021-16:49:13] [V] [TRT] [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_158, Tanh_159), Mul_160) (PointWise) [06/13/2021-16:49:13] [V] [TRT] Tactic: 128 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 256 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 512 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: -32 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: -64 time 0.078848 [06/13/2021-16:49:13] [V] [TRT] Tactic: -128 time 0.086016 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: -64 Time: 0.078848 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_158, Tanh_159), Mul_160) (PointWiseV2) [06/13/2021-16:49:13] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: -64 [06/13/2021-16:49:13] [V] [TRT] [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,32768) *************** [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_158, Tanh_159), Mul_160) (PointWise) [06/13/2021-16:49:13] [V] [TRT] Tactic: 128 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 256 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 512 time 0.079872 [06/13/2021-16:49:13] [V] [TRT] Tactic: -32 time 0.114688 [06/13/2021-16:49:13] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:13] [V] [TRT] Tactic: -128 time 0.077824 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: -128 Time: 0.077824 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_158, Tanh_159), Mul_160) (PointWiseV2) [06/13/2021-16:49:13] [V] [TRT] Tactic: 24 time 0.027648 [06/13/2021-16:49:13] [V] [TRT] Tactic: 25 time 0.027648 [06/13/2021-16:49:13] [V] [TRT] Tactic: 26 time 0.029696 [06/13/2021-16:49:13] [V] [TRT] Tactic: 27 time 0.026624 [06/13/2021-16:49:13] [V] [TRT] Tactic: 31 time 0.026624 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 27 Time: 0.026624 [06/13/2021-16:49:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [06/13/2021-16:49:13] [V] [TRT] [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,32768) -> Float(1,64,4096:32,32768) *************** [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:13] [V] [TRT] Tactic: 1002 time 0.123904 [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.064512 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 0 Time: 0.064512 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:13] [V] [TRT] Tactic: 1002 time 0.088064 [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.062464 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 0 Time: 0.062464 [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_166 (FusedConvActConvolution) [06/13/2021-16:49:13] [V] [TRT] Tactic: 458751 time 0.661504 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 458751 Time: 0.661504 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_166 (CaskConvolution) [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1062367460111450758 time 0.662528 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1754984623894446479 time 0.607456 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Tactic: 3611739942397549984 time 0.60416 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4337000649858996379 time 0.594944 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4501471010995462441 time 0.595968 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5137655947464784826 time 0.554368 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5288347012147084929 time 0.591872 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: 6645123197870846056 time 0.580608 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7144526460361122478 time 0.587776 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: -9137461792520977713 time 0.60928 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Tactic: -8262349710178828730 time 0.601088 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Tactic: -8133971918129952780 time 0.712928 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: -6092040395344634144 time 0.69632 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Tactic: -4787320710726427159 time 0.626688 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: -3456450830548107839 time 0.60416 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Tactic: -1218658103698133241 time 0.709856 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Tactic: -836875257600482091 time 0.679936 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: -410470605513481746 time 0.580608 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.554368 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_166 (CudaConvolution) [06/13/2021-16:49:13] [V] [TRT] Tactic: 0 time 0.801792 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1 time 0.62016 [06/13/2021-16:49:13] [V] [TRT] Tactic: 2 time 0.772096 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 524288000 [06/13/2021-16:49:13] [V] [TRT] Tactic: 56 time 0.807936 [06/13/2021-16:49:13] [V] [TRT] Tactic: 57 time 0.617472 [06/13/2021-16:49:13] [V] [TRT] Tactic: 58 time 0.772096 [06/13/2021-16:49:13] [V] [TRT] Tactic: 61 skipped. Scratch requested: 577110016, available: 524288000 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: 57 Time: 0.617472 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_166 (CudaDepthwiseConvolution) [06/13/2021-16:49:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_166 (CublasConvolution) [06/13/2021-16:49:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_166 (FusedConvActConvolution) [06/13/2021-16:49:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_166 (CaskConvolution) [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: -9153228964338181824 time 0.432128 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:13] [V] [TRT] Tactic: -7394439838318485025 time 0.472064 [06/13/2021-16:49:13] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.432128 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_166 (CudaConvolution) [06/13/2021-16:49:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_166 (CudaDepthwiseConvolution) [06/13/2021-16:49:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_166 (CublasConvolution) [06/13/2021-16:49:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:13] [V] [TRT] [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:13] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:13] [V] [TRT] --------------- Timing Runner: Conv_483 (FusedConvActConvolution) [06/13/2021-16:49:13] [V] [TRT] Tactic: 589823 time 0.22528 [06/13/2021-16:49:13] [V] [TRT] Tactic: 655359 time 0.146432 [06/13/2021-16:49:13] [V] [TRT] Tactic: 786431 time 0.159744 [06/13/2021-16:49:13] [V] [TRT] Tactic: 851967 time 0.142336 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1179647 time 0.130048 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1310719 time 0.644096 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1376255 time 0.152576 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1441791 time 0.195584 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1507327 time 0.147456 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1638399 time 0.177152 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1835007 time 0.15872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 1900543 time 0.154624 [06/13/2021-16:49:13] [V] [TRT] Tactic: 2097151 time 0.171008 [06/13/2021-16:49:13] [V] [TRT] Tactic: 2162687 time 0.159744 [06/13/2021-16:49:13] [V] [TRT] Tactic: 2293759 time 0.155648 [06/13/2021-16:49:13] [V] [TRT] Tactic: 2359295 time 0.136192 [06/13/2021-16:49:13] [V] [TRT] Tactic: 2686975 time 0.155648 [06/13/2021-16:49:13] [V] [TRT] Tactic: 3080191 time 0.144384 [06/13/2021-16:49:13] [V] [TRT] Tactic: 3342335 time 0.146432 [06/13/2021-16:49:13] [V] [TRT] Tactic: 3407871 time 0.132096 [06/13/2021-16:49:13] [V] [TRT] Tactic: 3538943 time 0.120832 [06/13/2021-16:49:13] [V] [TRT] Tactic: 3670015 time 0.153536 [06/13/2021-16:49:13] [V] [TRT] Tactic: 3932159 time 0.151552 [06/13/2021-16:49:13] [V] [TRT] Tactic: 3997695 time 0.151552 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4063231 time 0.146432 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4194303 time 0.17408 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4259839 time 0.155648 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4325375 time 0.159744 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4521983 time 0.175104 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4587519 time 0.157696 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4653055 time 0.139264 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4915199 time 0.155648 [06/13/2021-16:49:13] [V] [TRT] Tactic: 4980735 time 0.166912 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5177343 time 0.129024 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5242879 time 0.137216 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5373951 time 0.159744 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5439487 time 0.273408 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5570559 time 0.149504 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5636095 time 0.147456 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5701631 time 0.15872 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5767167 time 0.731136 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5832703 time 0.125952 [06/13/2021-16:49:13] [V] [TRT] Tactic: 5898239 time 0.12288 [06/13/2021-16:49:13] [V] [TRT] Tactic: 6029311 time 0.160768 [06/13/2021-16:49:13] [V] [TRT] Tactic: 6225919 time 0.132096 [06/13/2021-16:49:13] [V] [TRT] Tactic: 6291455 time 0.129024 [06/13/2021-16:49:13] [V] [TRT] Tactic: 6422527 time 0.139264 [06/13/2021-16:49:13] [V] [TRT] Tactic: 6750207 time 0.172032 [06/13/2021-16:49:13] [V] [TRT] Tactic: 6815743 time 0.190464 [06/13/2021-16:49:13] [V] [TRT] Tactic: 6946815 time 0.2304 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7012351 time 0.171008 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7077887 time 0.115712 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7143423 time 0.268288 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7208959 time 0.132096 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7340031 time 0.12288 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7405567 time 0.14336 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7536639 time 0.20992 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7602175 time 0.172032 [06/13/2021-16:49:13] [V] [TRT] Tactic: 7733247 time 0.121856 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7798783 time 0.160768 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8191999 time 0.212992 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8257535 time 0.155648 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8323071 time 0.181248 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8650751 time 0.186368 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8716287 time 0.193536 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9109503 time 0.16896 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9568255 time 0.152576 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9895935 time 0.164864 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10223615 time 0.154624 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10354687 time 0.150528 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10551295 time 0.188416 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10747903 time 0.121856 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10944511 time 0.167936 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 7077887 Time: 0.115712 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_483 (CaskConvolution) [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1062367460111450758 time 0.088064 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1698681053543049347 time 0.089088 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4501471010995462441 time 0.079872 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5137655947464784826 time 0.073728 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5288347012147084929 time 0.078848 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5326823351883942011 time 0.0768 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5500448035057547314 time 0.090112 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6645123197870846056 time 0.0768 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7144526460361122478 time 0.089088 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -8262349710178828730 time 0.079872 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -6576203419454146580 time 0.080896 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -4787320710726427159 time 0.089088 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -3456450830548107839 time 0.083968 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -1218658103698133241 time 0.094208 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -836875257600482091 time 0.09216 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -410470605513481746 time 0.077824 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -377491875521947884 time 0.07888 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -37215280111360163 time 0.073728 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.073728 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_483 (CudaConvolution) [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.157696 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1 time 0.105472 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2 time 0.237568 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1116078080, available: 524288000 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5 time 0.257024 [06/13/2021-16:49:14] [V] [TRT] Tactic: 56 time 0.157696 [06/13/2021-16:49:14] [V] [TRT] Tactic: 57 time 0.104448 [06/13/2021-16:49:14] [V] [TRT] Tactic: 58 time 0.238592 [06/13/2021-16:49:14] [V] [TRT] Tactic: 60 skipped. Scratch requested: 1116078080, available: 524288000 [06/13/2021-16:49:14] [V] [TRT] Tactic: 61 time 0.257024 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 57 Time: 0.104448 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_483 (CudaDepthwiseConvolution) [06/13/2021-16:49:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_483 (CublasConvolution) [06/13/2021-16:49:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_483 (FusedConvActConvolution) [06/13/2021-16:49:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_483 (CaskConvolution) [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3886731678879822788 time 0.065536 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6629944304117643200 time 0.069632 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -9153228964338181824 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -7394439838318485025 time 0.065536 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.065536 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_483 (CudaConvolution) [06/13/2021-16:49:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_483 (CudaDepthwiseConvolution) [06/13/2021-16:49:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_483 (CublasConvolution) [06/13/2021-16:49:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.029696 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.034816 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.029696 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.044032 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.04608 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.044032 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.029696 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.034816 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.029696 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.053248 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.062464 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.053248 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.06656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 0 Time: 0.032768 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.049152 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 0 Time: 0.032768 [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_167, Tanh_168), Mul_169) (PointWise) [06/13/2021-16:49:14] [V] [TRT] Tactic: 128 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 256 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 512 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:14] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:14] [V] [TRT] Tactic: -128 time 0.0768 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 128 Time: 0.070656 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_167, Tanh_168), Mul_169) (PointWiseV2) [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4 time 0.023552 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5 time 0.022528 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6 time 0.0256 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8 time 0.023552 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9 time 0.022528 [06/13/2021-16:49:14] [V] [TRT] Tactic: 28 time 0.024608 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 5 Time: 0.022528 [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_167, Tanh_168), Mul_169) (PointWise) [06/13/2021-16:49:14] [V] [TRT] Tactic: 128 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 256 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 512 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:14] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:14] [V] [TRT] Tactic: -128 time 0.0768 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 128 Time: 0.070656 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_167, Tanh_168), Mul_169) (PointWiseV2) [06/13/2021-16:49:14] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,16384) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_167, Tanh_168), Mul_169) (PointWise) [06/13/2021-16:49:14] [V] [TRT] Tactic: 128 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 256 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 512 time 0.07168 [06/13/2021-16:49:14] [V] [TRT] Tactic: -32 time 0.113664 [06/13/2021-16:49:14] [V] [TRT] Tactic: -64 time 0.080896 [06/13/2021-16:49:14] [V] [TRT] Tactic: -128 time 0.077824 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 128 Time: 0.070656 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_167, Tanh_168), Mul_169) (PointWiseV2) [06/13/2021-16:49:14] [V] [TRT] Tactic: 24 time 0.027648 [06/13/2021-16:49:14] [V] [TRT] Tactic: 25 time 0.027648 [06/13/2021-16:49:14] [V] [TRT] Tactic: 26 time 0.029696 [06/13/2021-16:49:14] [V] [TRT] Tactic: 27 time 0.026624 [06/13/2021-16:49:14] [V] [TRT] Tactic: 31 time 0.02688 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 27 Time: 0.026624 [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_170 || Conv_174 (FusedConvActConvolution) [06/13/2021-16:49:14] [V] [TRT] Tactic: 589823 time 0.388096 [06/13/2021-16:49:14] [V] [TRT] Tactic: 655359 time 0.241664 [06/13/2021-16:49:14] [V] [TRT] Tactic: 786431 time 0.28672 [06/13/2021-16:49:14] [V] [TRT] Tactic: 851967 time 0.236544 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1179647 time 0.196608 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1310719 time 1.15302 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1376255 time 0.248832 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1441791 time 0.366592 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1507327 time 0.241664 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1638399 time 0.309248 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1835007 time 0.273408 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1900543 time 0.254976 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2097151 time 0.279552 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2162687 time 0.262144 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2293759 time 0.25088 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2359295 time 0.227328 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2686975 time 0.251904 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3080191 time 0.231424 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3342335 time 0.24576 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3407871 time 0.205824 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3538943 time 0.188416 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3670015 time 0.246784 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3932159 time 0.303104 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3997695 time 0.270336 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4063231 time 0.224256 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4194303 time 0.274432 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4259839 time 0.253952 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4325375 time 0.285696 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4521983 time 0.304128 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4587519 time 0.259072 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4653055 time 0.212992 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4915199 time 0.252928 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4980735 time 0.292864 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5177343 time 0.203776 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5242879 time 0.22016 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5373951 time 0.260096 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5439487 time 0.398336 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5570559 time 0.24064 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5636095 time 0.224256 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5701631 time 0.251904 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5767167 time 0.93696 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5832703 time 0.198656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5898239 time 0.193536 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6029311 time 0.259072 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6225919 time 0.206848 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6291455 time 0.196608 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6422527 time 0.22528 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6750207 time 0.268288 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6815743 time 0.300032 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6946815 time 0.334848 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7012351 time 0.278528 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7077887 time 0.182272 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7143423 time 0.467968 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7208959 time 0.20992 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7340031 time 0.202752 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7405567 time 0.221184 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7536639 time 0.362496 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7602175 time 0.282624 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7733247 time 0.19968 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7798783 time 0.28672 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8191999 time 0.367616 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8257535 time 0.253952 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8323071 time 0.278528 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8650751 time 0.293888 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8716287 time 0.288768 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9109503 time 0.283648 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9568255 time 0.253952 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9895935 time 0.27648 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10223615 time 0.256 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10354687 time 0.241664 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10551295 time 0.313344 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10747903 time 0.188416 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10944511 time 0.29184 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 7077887 Time: 0.182272 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_170 || Conv_174 (CaskConvolution) [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1062367460111450758 time 0.155648 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1698681053543049347 time 0.13824 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4501471010995462441 time 0.142336 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5137655947464784826 time 0.131072 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5288347012147084929 time 0.141312 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5326823351883942011 time 0.13824 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5500448035057547314 time 0.156672 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6645123197870846056 time 0.134144 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7144526460361122478 time 0.144384 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -8262349710178828730 time 0.144384 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -6576203419454146580 time 0.133152 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -4787320710726427159 time 0.144384 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -3456450830548107839 time 0.144384 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -1218658103698133241 time 0.166912 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -836875257600482091 time 0.160768 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -410470605513481746 time 0.140288 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -377491875521947884 time 0.141312 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -37215280111360163 time 0.129216 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.129216 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_170 || Conv_174 (CudaConvolution) [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.252928 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1 time 0.167936 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2 time 0.289792 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2287206400, available: 524288000 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5 time 0.647168 [06/13/2021-16:49:14] [V] [TRT] Tactic: 56 time 0.253952 [06/13/2021-16:49:14] [V] [TRT] Tactic: 57 time 0.16896 [06/13/2021-16:49:14] [V] [TRT] Tactic: 58 time 0.287744 [06/13/2021-16:49:14] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2287206400, available: 524288000 [06/13/2021-16:49:14] [V] [TRT] Tactic: 61 time 0.643072 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1 Time: 0.167936 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_170 || Conv_174 (CudaDepthwiseConvolution) [06/13/2021-16:49:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_170 || Conv_174 (CublasConvolution) [06/13/2021-16:49:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_170 || Conv_174 (FusedConvActConvolution) [06/13/2021-16:49:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_170 || Conv_174 (CaskConvolution) [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3886731678879822788 time 0.114688 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6629944304117643200 time 0.111776 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -9153228964338181824 time 0.113664 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -7394439838318485025 time 0.113664 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 6629944304117643200 Time: 0.111776 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_170 || Conv_174 (CudaConvolution) [06/13/2021-16:49:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_170 || Conv_174 (CudaDepthwiseConvolution) [06/13/2021-16:49:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_170 || Conv_174 (CublasConvolution) [06/13/2021-16:49:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6629944304117643200 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.029696 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.034016 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.029696 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.045056 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.04608 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.045056 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.034816 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.028672 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.052224 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.062464 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.052224 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.021504 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.024576 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.032768 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 0 Time: 0.017408 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.022528 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_175, Tanh_176), Mul_177) (PointWise) [06/13/2021-16:49:14] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Tactic: 256 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Tactic: 512 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Tactic: -32 time 0.05632 [06/13/2021-16:49:14] [V] [TRT] Tactic: -64 time 0.043008 [06/13/2021-16:49:14] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 128 Time: 0.041984 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_175, Tanh_176), Mul_177) (PointWiseV2) [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1 time 0.012288 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2 time 0.011264 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3 time 0.011264 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4 time 0.01024 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5 time 0.009216 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6 time 0.01024 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7 time 0.009216 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8 time 0.008192 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9 time 0.008192 [06/13/2021-16:49:14] [V] [TRT] Tactic: 28 time 0.01536 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 8 Time: 0.008192 [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_175, Tanh_176), Mul_177) (PointWise) [06/13/2021-16:49:14] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Tactic: 256 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Tactic: 512 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Tactic: -32 time 0.047104 [06/13/2021-16:49:14] [V] [TRT] Tactic: -64 time 0.04096 [06/13/2021-16:49:14] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: -64 Time: 0.04096 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_175, Tanh_176), Mul_177) (PointWiseV2) [06/13/2021-16:49:14] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: -64 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,16384) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_175, Tanh_176), Mul_177) (PointWise) [06/13/2021-16:49:14] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Tactic: 256 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Tactic: 512 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Tactic: -32 time 0.05632 [06/13/2021-16:49:14] [V] [TRT] Tactic: -64 time 0.043008 [06/13/2021-16:49:14] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 128 Time: 0.041984 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_175, Tanh_176), Mul_177) (PointWiseV2) [06/13/2021-16:49:14] [V] [TRT] Tactic: 24 time 0.013312 [06/13/2021-16:49:14] [V] [TRT] Tactic: 25 time 0.01536 [06/13/2021-16:49:14] [V] [TRT] Tactic: 26 time 0.013312 [06/13/2021-16:49:14] [V] [TRT] Tactic: 27 time 0.016384 [06/13/2021-16:49:14] [V] [TRT] Tactic: 31 time 0.013312 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 24 Time: 0.013312 [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.021504 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.013536 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.013536 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.03072 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.024576 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.032768 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 0 Time: 0.017408 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.022528 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.033792 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 0 Time: 0.017408 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.022528 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_178 (FusedConvActConvolution) [06/13/2021-16:49:14] [V] [TRT] Tactic: 589823 time 0.111616 [06/13/2021-16:49:14] [V] [TRT] Tactic: 655359 time 0.074752 [06/13/2021-16:49:14] [V] [TRT] Tactic: 786431 time 0.093184 [06/13/2021-16:49:14] [V] [TRT] Tactic: 851967 time 0.073728 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1179647 time 0.06656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1310719 time 0.160768 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1376255 time 0.078848 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1441791 time 0.11264 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1507327 time 0.0768 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1638399 time 0.094208 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1835007 time 0.08704 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1900543 time 0.078848 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2097151 time 0.08704 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2162687 time 0.079872 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2293759 time 0.08192 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2359295 time 0.082944 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2686975 time 0.082944 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3080191 time 0.072704 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3342335 time 0.0768 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3407871 time 0.073728 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3538943 time 0.063488 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3670015 time 0.114688 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3932159 time 0.09728 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3997695 time 0.088064 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4063231 time 0.074752 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4194303 time 0.090112 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4259839 time 0.080896 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4325375 time 0.088064 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4521983 time 0.090112 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4587519 time 0.080896 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4653055 time 0.069632 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4915199 time 0.083968 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4980735 time 0.09728 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5177343 time 0.06656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5242879 time 0.077824 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5373951 time 0.0768 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5439487 time 0.124928 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5570559 time 0.0768 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5636095 time 0.074752 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5701631 time 0.075776 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5767167 time 0.2304 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5832703 time 0.069632 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5898239 time 0.062464 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6029311 time 0.079872 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6225919 time 0.067584 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6291455 time 0.065536 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6422527 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6750207 time 0.084224 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6815743 time 0.088064 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6946815 time 0.099328 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7012351 time 0.08704 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7077887 time 0.060416 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7143423 time 0.136192 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7208959 time 0.070656 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7340031 time 0.062464 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7405567 time 0.07168 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7536639 time 0.113664 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7602175 time 0.086016 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7733247 time 0.062464 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7798783 time 0.093184 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8191999 time 0.105472 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8257535 time 0.082944 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8323071 time 0.090112 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8650751 time 0.08704 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8716287 time 0.082944 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9109503 time 0.086016 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9568255 time 0.083968 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9895935 time 0.090112 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10223615 time 0.08192 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10354687 time 0.078848 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10551295 time 0.093184 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10747903 time 0.062464 [06/13/2021-16:49:14] [V] [TRT] Tactic: 10944511 time 0.09728 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 7077887 Time: 0.060416 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_178 (CaskConvolution) [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1062367460111450758 time 0.050176 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1698681053543049347 time 0.038912 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4501471010995462441 time 0.048128 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5137655947464784826 time 0.044032 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5288347012147084929 time 0.049152 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5326823351883942011 time 0.048128 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5500448035057547314 time 0.04608 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6645123197870846056 time 0.045056 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7144526460361122478 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -8262349710178828730 time 0.048128 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -6576203419454146580 time 0.04608 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -4787320710726427159 time 0.044032 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -3456450830548107839 time 0.048128 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -1218658103698133241 time 0.048128 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -836875257600482091 time 0.047104 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -410470605513481746 time 0.048128 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Tactic: -377491875521947884 time 0.048128 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -37215280111360163 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1698681053543049347 Time: 0.038912 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_178 (CudaConvolution) [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.082944 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1 time 0.069632 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2 time 0.167936 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4 skipped. Scratch requested: 572915712, available: 524288000 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5 time 0.218112 [06/13/2021-16:49:14] [V] [TRT] Tactic: 56 time 0.082944 [06/13/2021-16:49:14] [V] [TRT] Tactic: 57 time 0.068608 [06/13/2021-16:49:14] [V] [TRT] Tactic: 58 time 0.166912 [06/13/2021-16:49:14] [V] [TRT] Tactic: 60 skipped. Scratch requested: 572915712, available: 524288000 [06/13/2021-16:49:14] [V] [TRT] Tactic: 61 time 0.219008 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 57 Time: 0.068608 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_178 (CudaDepthwiseConvolution) [06/13/2021-16:49:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_178 (CublasConvolution) [06/13/2021-16:49:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_178 (FusedConvActConvolution) [06/13/2021-16:49:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_178 (CaskConvolution) [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3886731678879822788 time 0.04096 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6629944304117643200 time 0.039936 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -9153228964338181824 time 0.039936 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Tactic: -7394439838318485025 time 0.04096 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 6629944304117643200 Time: 0.039936 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_178 (CudaConvolution) [06/13/2021-16:49:14] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_178 (CudaDepthwiseConvolution) [06/13/2021-16:49:14] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_178 (CublasConvolution) [06/13/2021-16:49:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6629944304117643200 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.021504 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:14] [V] [TRT] Tactic: 1002 time 0.024576 [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.03072 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 1002 Time: 0.024576 [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_179, Tanh_180), Mul_181) (PointWise) [06/13/2021-16:49:14] [V] [TRT] Tactic: 128 time 0.036864 [06/13/2021-16:49:14] [V] [TRT] Tactic: 256 time 0.036864 [06/13/2021-16:49:14] [V] [TRT] Tactic: 512 time 0.036864 [06/13/2021-16:49:14] [V] [TRT] Tactic: -32 time 0.057344 [06/13/2021-16:49:14] [V] [TRT] Tactic: -64 time 0.043008 [06/13/2021-16:49:14] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 128 Time: 0.036864 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_179, Tanh_180), Mul_181) (PointWiseV2) [06/13/2021-16:49:14] [V] [TRT] Tactic: 0 time 0.013312 [06/13/2021-16:49:14] [V] [TRT] Tactic: 1 time 0.01024 [06/13/2021-16:49:14] [V] [TRT] Tactic: 2 time 0.01024 [06/13/2021-16:49:14] [V] [TRT] Tactic: 3 time 0.01024 [06/13/2021-16:49:14] [V] [TRT] Tactic: 4 time 0.009216 [06/13/2021-16:49:14] [V] [TRT] Tactic: 5 time 0.008192 [06/13/2021-16:49:14] [V] [TRT] Tactic: 6 time 0.01024 [06/13/2021-16:49:14] [V] [TRT] Tactic: 7 time 0.008192 [06/13/2021-16:49:14] [V] [TRT] Tactic: 8 time 0.008192 [06/13/2021-16:49:14] [V] [TRT] Tactic: 9 time 0.008192 [06/13/2021-16:49:14] [V] [TRT] Tactic: 28 time 0.013312 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 5 Time: 0.008192 [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_179, Tanh_180), Mul_181) (PointWise) [06/13/2021-16:49:14] [V] [TRT] Tactic: 128 time 0.037888 [06/13/2021-16:49:14] [V] [TRT] Tactic: 256 time 0.036864 [06/13/2021-16:49:14] [V] [TRT] Tactic: 512 time 0.037888 [06/13/2021-16:49:14] [V] [TRT] Tactic: -32 time 0.057344 [06/13/2021-16:49:14] [V] [TRT] Tactic: -64 time 0.043008 [06/13/2021-16:49:14] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 256 Time: 0.036864 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_179, Tanh_180), Mul_181) (PointWiseV2) [06/13/2021-16:49:14] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 256 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_179, Tanh_180), Mul_181) (PointWise) [06/13/2021-16:49:14] [V] [TRT] Tactic: 128 time 0.036864 [06/13/2021-16:49:14] [V] [TRT] Tactic: 256 time 0.036864 [06/13/2021-16:49:14] [V] [TRT] Tactic: 512 time 0.037888 [06/13/2021-16:49:14] [V] [TRT] Tactic: -32 time 0.057344 [06/13/2021-16:49:14] [V] [TRT] Tactic: -64 time 0.043232 [06/13/2021-16:49:14] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 128 Time: 0.036864 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_179, Tanh_180), Mul_181) (PointWiseV2) [06/13/2021-16:49:14] [V] [TRT] Tactic: 24 time 0.013312 [06/13/2021-16:49:14] [V] [TRT] Tactic: 25 time 0.014336 [06/13/2021-16:49:14] [V] [TRT] Tactic: 26 time 0.013312 [06/13/2021-16:49:14] [V] [TRT] Tactic: 27 time 0.01536 [06/13/2021-16:49:14] [V] [TRT] Tactic: 31 time 0.013312 [06/13/2021-16:49:14] [V] [TRT] Fastest Tactic: 24 Time: 0.013312 [06/13/2021-16:49:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:14] [V] [TRT] [06/13/2021-16:49:14] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:14] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:14] [V] [TRT] --------------- Timing Runner: Conv_182 (FusedConvActConvolution) [06/13/2021-16:49:14] [V] [TRT] Tactic: 524287 time 0.29696 [06/13/2021-16:49:14] [V] [TRT] Tactic: 720895 time 0.295936 [06/13/2021-16:49:15] [V] [TRT] Tactic: 983039 time 0.24064 [06/13/2021-16:49:15] [V] [TRT] Tactic: 1048575 time 0.304128 [06/13/2021-16:49:15] [V] [TRT] Tactic: 1703935 time 0.264192 [06/13/2021-16:49:15] [V] [TRT] Tactic: 1769471 time 0.354304 [06/13/2021-16:49:15] [V] [TRT] Tactic: 1966079 time 0.308224 [06/13/2021-16:49:15] [V] [TRT] Tactic: 2031615 time 0.320512 [06/13/2021-16:49:15] [V] [TRT] Tactic: 2228223 time 0.30208 [06/13/2021-16:49:15] [V] [TRT] Tactic: 2424831 time 0.434176 [06/13/2021-16:49:15] [V] [TRT] Tactic: 2621439 time 0.26624 [06/13/2021-16:49:15] [V] [TRT] Tactic: 2752511 time 0.315392 [06/13/2021-16:49:15] [V] [TRT] Tactic: 2818047 time 0.437248 [06/13/2021-16:49:15] [V] [TRT] Tactic: 2883583 time 0.305152 [06/13/2021-16:49:15] [V] [TRT] Tactic: 3014655 time 0.257024 [06/13/2021-16:49:15] [V] [TRT] Tactic: 3145727 time 0.285696 [06/13/2021-16:49:15] [V] [TRT] Tactic: 3473407 time 0.305152 [06/13/2021-16:49:15] [V] [TRT] Tactic: 3604479 time 0.251904 [06/13/2021-16:49:15] [V] [TRT] Tactic: 3735551 time 0.280576 [06/13/2021-16:49:15] [V] [TRT] Tactic: 4390911 time 0.362496 [06/13/2021-16:49:15] [V] [TRT] Tactic: 5046271 time 0.275456 [06/13/2021-16:49:15] [V] [TRT] Tactic: 5963775 time 0.282624 [06/13/2021-16:49:15] [V] [TRT] Tactic: 6160383 time 0.30208 [06/13/2021-16:49:15] [V] [TRT] Tactic: 6488063 time 0.314368 [06/13/2021-16:49:15] [V] [TRT] Tactic: 6881279 time 0.27648 [06/13/2021-16:49:15] [V] [TRT] Tactic: 7274495 time 0.2808 [06/13/2021-16:49:15] [V] [TRT] Tactic: 7864319 time 0.316416 [06/13/2021-16:49:15] [V] [TRT] Tactic: 7995391 time 0.28672 [06/13/2021-16:49:15] [V] [TRT] Tactic: 8585215 time 0.308224 [06/13/2021-16:49:15] [V] [TRT] Tactic: 8847359 time 0.3072 [06/13/2021-16:49:15] [V] [TRT] Tactic: 8978431 time 0.29184 [06/13/2021-16:49:15] [V] [TRT] Tactic: 9043967 time 0.287744 [06/13/2021-16:49:15] [V] [TRT] Tactic: 9175039 time 0.252928 [06/13/2021-16:49:15] [V] [TRT] Tactic: 9502719 time 0.355328 [06/13/2021-16:49:15] [V] [TRT] Tactic: 9830399 time 0.275456 [06/13/2021-16:49:15] [V] [TRT] Tactic: 9961471 time 0.277504 [06/13/2021-16:49:15] [V] [TRT] Tactic: 10027007 time 0.29696 [06/13/2021-16:49:15] [V] [TRT] Tactic: 10092543 time 0.36352 [06/13/2021-16:49:15] [V] [TRT] Tactic: 10289151 time 0.308224 [06/13/2021-16:49:15] [V] [TRT] Tactic: 10485759 time 0.283648 [06/13/2021-16:49:15] [V] [TRT] Tactic: 10682367 time 0.267264 [06/13/2021-16:49:15] [V] [TRT] Tactic: 10813439 time 0.236544 [06/13/2021-16:49:15] [V] [TRT] Fastest Tactic: 10813439 Time: 0.236544 [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: Conv_182 (CaskConvolution) [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: 1062367460111450758 time 0.351232 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: 1754984623894446479 time 0.328704 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: 3611739942397549984 time 0.372736 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: 3827454225649558724 time 0.132096 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: 4337000649858996379 time 0.311296 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: 4501471010995462441 time 0.370688 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: 5137655947464784826 time 0.292864 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: 5288347012147084929 time 0.362496 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: 5921334924264294896 time 0.141312 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: 6645123197870846056 time 0.308224 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: 7144526460361122478 time 0.290816 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: 7852627285308570038 time 0.141312 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: -9137461792520977713 time 0.377856 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: -8776506421218919509 time 0.130048 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: -8262349710178828730 time 0.371712 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: -8133971918129952780 time 0.331776 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: -6092040395344634144 time 0.365568 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: -4787320710726427159 time 0.326912 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: -3456450830548107839 time 0.32256 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: -2318106587342035239 time 0.136192 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: -1343271414618805657 time 0.136192 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: -1218658103698133241 time 0.330752 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Tactic: -836875257600482091 time 0.313344 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: -410470605513481746 time 0.362496 [06/13/2021-16:49:15] [V] [TRT] Fastest Tactic: -8776506421218919509 Time: 0.130048 [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: Conv_182 (CudaConvolution) [06/13/2021-16:49:15] [V] [TRT] Tactic: 0 time 0.579584 [06/13/2021-16:49:15] [V] [TRT] Tactic: 1 time 0.303104 [06/13/2021-16:49:15] [V] [TRT] Tactic: 2 time 0.52224 [06/13/2021-16:49:15] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2225602560, available: 524288000 [06/13/2021-16:49:15] [V] [TRT] Tactic: 5 time 6.92509 [06/13/2021-16:49:15] [V] [TRT] Tactic: 6 time 0.183296 [06/13/2021-16:49:15] [V] [TRT] Tactic: 56 time 0.58368 [06/13/2021-16:49:15] [V] [TRT] Tactic: 57 time 0.306176 [06/13/2021-16:49:15] [V] [TRT] Tactic: 58 time 0.524288 [06/13/2021-16:49:15] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2225602560, available: 524288000 [06/13/2021-16:49:15] [V] [TRT] Tactic: 61 time 6.91507 [06/13/2021-16:49:15] [V] [TRT] Tactic: 62 time 0.180224 [06/13/2021-16:49:15] [V] [TRT] Fastest Tactic: 62 Time: 0.180224 [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: Conv_182 (CudaDepthwiseConvolution) [06/13/2021-16:49:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: Conv_182 (CublasConvolution) [06/13/2021-16:49:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8776506421218919509 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:15] [V] [TRT] [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: Conv_182 (FusedConvActConvolution) [06/13/2021-16:49:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: Conv_182 (CaskConvolution) [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: -9153228964338181824 time 0.239616 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:15] [V] [TRT] Tactic: -7394439838318485025 time 0.284672 [06/13/2021-16:49:15] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.239616 [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: Conv_182 (CudaConvolution) [06/13/2021-16:49:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: Conv_182 (CudaDepthwiseConvolution) [06/13/2021-16:49:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: Conv_182 (CublasConvolution) [06/13/2021-16:49:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:15] [V] [TRT] [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:15] [V] [TRT] Conv_182 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_183, Tanh_184), Mul_185), Add_186) (PointWise) [06/13/2021-16:49:15] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:15] [V] [TRT] Tactic: 256 time 0.043008 [06/13/2021-16:49:15] [V] [TRT] Tactic: 512 time 0.043008 [06/13/2021-16:49:15] [V] [TRT] Tactic: -32 time 0.06656 [06/13/2021-16:49:15] [V] [TRT] Tactic: -64 time 0.048128 [06/13/2021-16:49:15] [V] [TRT] Tactic: -128 time 0.048128 [06/13/2021-16:49:15] [V] [TRT] Fastest Tactic: 128 Time: 0.041984 [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_183, Tanh_184), Mul_185), Add_186) (PointWiseV2) [06/13/2021-16:49:15] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Tactic: 1 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Tactic: 2 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Tactic: 3 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Tactic: 4 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Tactic: 5 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Tactic: 6 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Tactic: 7 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Tactic: 8 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Tactic: 9 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Tactic: 28 time 0.018432 [06/13/2021-16:49:15] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [06/13/2021-16:49:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [06/13/2021-16:49:15] [V] [TRT] [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144), Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_183, Tanh_184), Mul_185), Add_186) (PointWise) [06/13/2021-16:49:15] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:15] [V] [TRT] Tactic: 256 time 0.043008 [06/13/2021-16:49:15] [V] [TRT] Tactic: 512 time 0.043008 [06/13/2021-16:49:15] [V] [TRT] Tactic: -32 time 0.065536 [06/13/2021-16:49:15] [V] [TRT] Tactic: -64 time 0.049152 [06/13/2021-16:49:15] [V] [TRT] Tactic: -128 time 0.048128 [06/13/2021-16:49:15] [V] [TRT] Fastest Tactic: 128 Time: 0.041984 [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_183, Tanh_184), Mul_185), Add_186) (PointWiseV2) [06/13/2021-16:49:15] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:15] [V] [TRT] [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192), Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_183, Tanh_184), Mul_185), Add_186) (PointWise) [06/13/2021-16:49:15] [V] [TRT] Tactic: 128 time 0.043008 [06/13/2021-16:49:15] [V] [TRT] Tactic: 256 time 0.043008 [06/13/2021-16:49:15] [V] [TRT] Tactic: 512 time 0.043008 [06/13/2021-16:49:15] [V] [TRT] Tactic: -32 time 0.065536 [06/13/2021-16:49:15] [V] [TRT] Tactic: -64 time 0.048128 [06/13/2021-16:49:15] [V] [TRT] Tactic: -128 time 0.048128 [06/13/2021-16:49:15] [V] [TRT] Fastest Tactic: 128 Time: 0.043008 [06/13/2021-16:49:15] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_183, Tanh_184), Mul_185), Add_186) (PointWiseV2) [06/13/2021-16:49:15] [V] [TRT] Tactic: 24 time 0.0256 [06/13/2021-16:49:15] [V] [TRT] Tactic: 25 time 0.023552 [06/13/2021-16:49:15] [V] [TRT] Tactic: 26 time 0.02048 [06/13/2021-16:49:15] [V] [TRT] Tactic: 27 time 0.022528 [06/13/2021-16:49:15] [V] [TRT] Tactic: 31 time 0.023552 [06/13/2021-16:49:15] [V] [TRT] Fastest Tactic: 26 Time: 0.02048 [06/13/2021-16:49:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [06/13/2021-16:49:15] [V] [TRT] [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144), Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192), Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144), Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192), Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144), Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192), Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144), Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192), Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144), Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192), Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:15] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144), Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192), Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144), Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144), Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192), Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_171, Tanh_172), Mul_173) (PointWise) [06/13/2021-16:49:16] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 256 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 512 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: -32 time 0.05632 [06/13/2021-16:49:16] [V] [TRT] Tactic: -64 time 0.043008 [06/13/2021-16:49:16] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 128 Time: 0.041984 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_171, Tanh_172), Mul_173) (PointWiseV2) [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 0.016384 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1 time 0.012288 [06/13/2021-16:49:16] [V] [TRT] Tactic: 2 time 0.011456 [06/13/2021-16:49:16] [V] [TRT] Tactic: 3 time 0.01024 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4 time 0.01024 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5 time 0.009216 [06/13/2021-16:49:16] [V] [TRT] Tactic: 6 time 0.01024 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7 time 0.009216 [06/13/2021-16:49:16] [V] [TRT] Tactic: 8 time 0.009216 [06/13/2021-16:49:16] [V] [TRT] Tactic: 9 time 0.009216 [06/13/2021-16:49:16] [V] [TRT] Tactic: 28 time 0.01536 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 5 Time: 0.009216 [06/13/2021-16:49:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [06/13/2021-16:49:16] [V] [TRT] [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_171, Tanh_172), Mul_173) (PointWise) [06/13/2021-16:49:16] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 256 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 512 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: -32 time 0.047104 [06/13/2021-16:49:16] [V] [TRT] Tactic: -64 time 0.04096 [06/13/2021-16:49:16] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: -64 Time: 0.04096 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_171, Tanh_172), Mul_173) (PointWiseV2) [06/13/2021-16:49:16] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: -64 [06/13/2021-16:49:16] [V] [TRT] [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,16384) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_171, Tanh_172), Mul_173) (PointWise) [06/13/2021-16:49:16] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 256 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 512 time 0.043008 [06/13/2021-16:49:16] [V] [TRT] Tactic: -32 time 0.05632 [06/13/2021-16:49:16] [V] [TRT] Tactic: -64 time 0.043008 [06/13/2021-16:49:16] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 128 Time: 0.041984 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_171, Tanh_172), Mul_173) (PointWiseV2) [06/13/2021-16:49:16] [V] [TRT] Tactic: 24 time 0.014336 [06/13/2021-16:49:16] [V] [TRT] Tactic: 25 time 0.01536 [06/13/2021-16:49:16] [V] [TRT] Tactic: 26 time 0.013312 [06/13/2021-16:49:16] [V] [TRT] Tactic: 27 time 0.01536 [06/13/2021-16:49:16] [V] [TRT] Tactic: 31 time 0.013312 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 26 Time: 0.013312 [06/13/2021-16:49:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [06/13/2021-16:49:16] [V] [TRT] [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:16] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:16] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.021504 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:16] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 0.016384 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:16] [V] [TRT] Tactic: 1002 time 0.023552 [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 0.031744 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.023552 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:16] [V] [TRT] Tactic: 1002 time 0.032768 [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 0 Time: 0.017408 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:16] [V] [TRT] Tactic: 1002 time 0.022528 [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_251, Tanh_252), Mul_253) (PointWise) [06/13/2021-16:49:16] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 256 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 512 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: -32 time 0.058368 [06/13/2021-16:49:16] [V] [TRT] Tactic: -64 time 0.043008 [06/13/2021-16:49:16] [V] [TRT] Tactic: -128 time 0.043008 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 128 Time: 0.041984 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_251, Tanh_252), Mul_253) (PointWiseV2) [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1 time 0.012288 [06/13/2021-16:49:16] [V] [TRT] Tactic: 2 time 0.012096 [06/13/2021-16:49:16] [V] [TRT] Tactic: 3 time 0.011264 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4 time 0.01024 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5 time 0.009216 [06/13/2021-16:49:16] [V] [TRT] Tactic: 6 time 0.011264 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7 time 0.009216 [06/13/2021-16:49:16] [V] [TRT] Tactic: 8 time 0.009216 [06/13/2021-16:49:16] [V] [TRT] Tactic: 9 time 0.008192 [06/13/2021-16:49:16] [V] [TRT] Tactic: 28 time 0.01536 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 9 Time: 0.008192 [06/13/2021-16:49:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [06/13/2021-16:49:16] [V] [TRT] [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_251, Tanh_252), Mul_253) (PointWise) [06/13/2021-16:49:16] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 256 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 512 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: -32 time 0.048128 [06/13/2021-16:49:16] [V] [TRT] Tactic: -64 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 128 Time: 0.041984 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_251, Tanh_252), Mul_253) (PointWiseV2) [06/13/2021-16:49:16] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:16] [V] [TRT] [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_251, Tanh_252), Mul_253) (PointWise) [06/13/2021-16:49:16] [V] [TRT] Tactic: 128 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 256 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: 512 time 0.041984 [06/13/2021-16:49:16] [V] [TRT] Tactic: -32 time 0.058368 [06/13/2021-16:49:16] [V] [TRT] Tactic: -64 time 0.043008 [06/13/2021-16:49:16] [V] [TRT] Tactic: -128 time 0.043008 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 128 Time: 0.041984 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_251, Tanh_252), Mul_253) (PointWiseV2) [06/13/2021-16:49:16] [V] [TRT] Tactic: 24 time 0.014336 [06/13/2021-16:49:16] [V] [TRT] Tactic: 25 time 0.01536 [06/13/2021-16:49:16] [V] [TRT] Tactic: 26 time 0.013312 [06/13/2021-16:49:16] [V] [TRT] Tactic: 27 time 0.01536 [06/13/2021-16:49:16] [V] [TRT] Tactic: 31 time 0.013312 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 26 Time: 0.013312 [06/13/2021-16:49:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [06/13/2021-16:49:16] [V] [TRT] [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,16384) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:16] [V] [TRT] Tactic: 1002 time 0.065536 [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 0 Time: 0.032768 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:16] [V] [TRT] Tactic: 1002 time 0.048128 [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 0 Time: 0.032768 [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_259 (FusedConvActConvolution) [06/13/2021-16:49:16] [V] [TRT] Tactic: 458751 time 0.769024 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 458751 Time: 0.769024 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_259 (CaskConvolution) [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1062367460111450758 time 0.702464 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1754984623894446479 time 0.681984 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Tactic: 3611739942397549984 time 0.761856 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4337000649858996379 time 0.642048 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4501471010995462441 time 0.75264 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5137655947464784826 time 0.59968 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5288347012147084929 time 0.744448 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: 6645123197870846056 time 0.631584 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7144526460361122478 time 0.644096 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: -9137461792520977713 time 0.765952 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Tactic: -8262349710178828730 time 0.760576 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Tactic: -8133971918129952780 time 0.717824 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: -6092040395344634144 time 0.735232 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Tactic: -4787320710726427159 time 0.677888 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: -3456450830548107839 time 0.644096 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Tactic: -1218658103698133241 time 0.709632 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Tactic: -836875257600482091 time 0.687104 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: -410470605513481746 time 0.73216 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.59968 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_259 (CudaConvolution) [06/13/2021-16:49:16] [V] [TRT] Tactic: 0 time 1.01274 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1 time 1.43872 [06/13/2021-16:49:16] [V] [TRT] Tactic: 2 time 0.8384 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5 skipped. Scratch requested: 2295070720, available: 524288000 [06/13/2021-16:49:16] [V] [TRT] Tactic: 56 time 0.989184 [06/13/2021-16:49:16] [V] [TRT] Tactic: 57 time 1.39469 [06/13/2021-16:49:16] [V] [TRT] Tactic: 58 time 0.841504 [06/13/2021-16:49:16] [V] [TRT] Tactic: 61 skipped. Scratch requested: 2295070720, available: 524288000 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: 2 Time: 0.8384 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_259 (CudaDepthwiseConvolution) [06/13/2021-16:49:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_259 (CublasConvolution) [06/13/2021-16:49:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_259 (FusedConvActConvolution) [06/13/2021-16:49:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_259 (CaskConvolution) [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: -9153228964338181824 time 0.473088 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:16] [V] [TRT] Tactic: -7394439838318485025 time 0.569344 [06/13/2021-16:49:16] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.473088 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_259 (CudaConvolution) [06/13/2021-16:49:16] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_259 (CudaDepthwiseConvolution) [06/13/2021-16:49:16] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_259 (CublasConvolution) [06/13/2021-16:49:16] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:16] [V] [TRT] [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:16] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:16] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:16] [V] [TRT] --------------- Timing Runner: Conv_401 (FusedConvActConvolution) [06/13/2021-16:49:16] [V] [TRT] Tactic: 589823 time 0.193536 [06/13/2021-16:49:16] [V] [TRT] Tactic: 655359 time 0.123904 [06/13/2021-16:49:16] [V] [TRT] Tactic: 786431 time 0.156672 [06/13/2021-16:49:16] [V] [TRT] Tactic: 851967 time 0.123904 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1179647 time 0.10752 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1310719 time 0.289792 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1376255 time 0.131072 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1441791 time 0.196608 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1507327 time 0.128 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1638399 time 0.162816 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1835007 time 0.149504 [06/13/2021-16:49:16] [V] [TRT] Tactic: 1900543 time 0.129024 [06/13/2021-16:49:16] [V] [TRT] Tactic: 2097151 time 0.142336 [06/13/2021-16:49:16] [V] [TRT] Tactic: 2162687 time 0.139264 [06/13/2021-16:49:16] [V] [TRT] Tactic: 2293759 time 0.135168 [06/13/2021-16:49:16] [V] [TRT] Tactic: 2359295 time 0.139264 [06/13/2021-16:49:16] [V] [TRT] Tactic: 2686975 time 0.136192 [06/13/2021-16:49:16] [V] [TRT] Tactic: 3080191 time 0.121856 [06/13/2021-16:49:16] [V] [TRT] Tactic: 3342335 time 0.128 [06/13/2021-16:49:16] [V] [TRT] Tactic: 3407871 time 0.128 [06/13/2021-16:49:16] [V] [TRT] Tactic: 3538943 time 0.104448 [06/13/2021-16:49:16] [V] [TRT] Tactic: 3670015 time 0.222208 [06/13/2021-16:49:16] [V] [TRT] Tactic: 3932159 time 0.188416 [06/13/2021-16:49:16] [V] [TRT] Tactic: 3997695 time 0.145408 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4063231 time 0.12288 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4194303 time 0.1536 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4259839 time 0.13312 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4325375 time 0.147456 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4521983 time 0.150528 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4587519 time 0.135168 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4653055 time 0.113664 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4915199 time 0.140288 [06/13/2021-16:49:16] [V] [TRT] Tactic: 4980735 time 0.162816 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5177343 time 0.108544 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5242879 time 0.131072 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5373951 time 0.131072 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5439487 time 0.2304 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5570559 time 0.125952 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5636095 time 0.121856 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5701631 time 0.129024 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5767167 time 0.462848 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5832703 time 0.120832 [06/13/2021-16:49:16] [V] [TRT] Tactic: 5898239 time 0.101376 [06/13/2021-16:49:16] [V] [TRT] Tactic: 6029311 time 0.136192 [06/13/2021-16:49:16] [V] [TRT] Tactic: 6225919 time 0.110592 [06/13/2021-16:49:16] [V] [TRT] Tactic: 6291455 time 0.10752 [06/13/2021-16:49:16] [V] [TRT] Tactic: 6422527 time 0.116736 [06/13/2021-16:49:16] [V] [TRT] Tactic: 6750207 time 0.140288 [06/13/2021-16:49:16] [V] [TRT] Tactic: 6815743 time 0.160768 [06/13/2021-16:49:16] [V] [TRT] Tactic: 6946815 time 0.175104 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7012351 time 0.142336 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7077887 time 0.101376 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7143423 time 0.239616 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7208959 time 0.126976 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7340031 time 0.1024 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7405567 time 0.119808 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7536639 time 0.210944 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7602175 time 0.146432 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7733247 time 0.104448 [06/13/2021-16:49:16] [V] [TRT] Tactic: 7798783 time 0.156672 [06/13/2021-16:49:16] [V] [TRT] Tactic: 8191999 time 0.185344 [06/13/2021-16:49:16] [V] [TRT] Tactic: 8257535 time 0.136192 [06/13/2021-16:49:16] [V] [TRT] Tactic: 8323071 time 0.154624 [06/13/2021-16:49:16] [V] [TRT] Tactic: 8650751 time 0.150528 [06/13/2021-16:49:16] [V] [TRT] Tactic: 8716287 time 0.149504 [06/13/2021-16:49:17] [V] [TRT] Tactic: 9109503 time 0.142336 [06/13/2021-16:49:17] [V] [TRT] Tactic: 9568255 time 0.139264 [06/13/2021-16:49:17] [V] [TRT] Tactic: 9895935 time 0.151552 [06/13/2021-16:49:17] [V] [TRT] Tactic: 10223615 time 0.137216 [06/13/2021-16:49:17] [V] [TRT] Tactic: 10354687 time 0.126976 [06/13/2021-16:49:17] [V] [TRT] Tactic: 10551295 time 0.160768 [06/13/2021-16:49:17] [V] [TRT] Tactic: 10747903 time 0.1024 [06/13/2021-16:49:17] [V] [TRT] Tactic: 10944511 time 0.16896 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 5898239 Time: 0.101376 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_401 (CaskConvolution) [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1062367460111450758 time 0.08704 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1698681053543049347 time 0.07168 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4501471010995462441 time 0.088064 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5137655947464784826 time 0.075776 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5288347012147084929 time 0.08704 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5326823351883942011 time 0.086016 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5500448035057547314 time 0.083968 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6645123197870846056 time 0.0768 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7144526460361122478 time 0.074752 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: -8262349710178828730 time 0.088064 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -6576203419454146580 time 0.078848 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: -4787320710726427159 time 0.077824 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -3456450830548107839 time 0.083968 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: -1218658103698133241 time 0.089088 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: -836875257600482091 time 0.086016 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -410470605513481746 time 0.08704 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: -377491875521947884 time 0.086016 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -37215280111360163 time 0.072704 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1698681053543049347 Time: 0.07168 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_401 (CudaConvolution) [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.146432 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1 time 0.116736 [06/13/2021-16:49:17] [V] [TRT] Tactic: 2 time 0.216064 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1145831424, available: 524288000 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5 time 0.375808 [06/13/2021-16:49:17] [V] [TRT] Tactic: 56 time 0.146432 [06/13/2021-16:49:17] [V] [TRT] Tactic: 57 time 0.116736 [06/13/2021-16:49:17] [V] [TRT] Tactic: 58 time 0.22016 [06/13/2021-16:49:17] [V] [TRT] Tactic: 60 skipped. Scratch requested: 1145831424, available: 524288000 [06/13/2021-16:49:17] [V] [TRT] Tactic: 61 time 0.377856 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1 Time: 0.116736 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_401 (CudaDepthwiseConvolution) [06/13/2021-16:49:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_401 (CublasConvolution) [06/13/2021-16:49:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_401 (FusedConvActConvolution) [06/13/2021-16:49:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_401 (CaskConvolution) [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3886731678879822788 time 0.070656 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6629944304117643200 time 0.064512 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -9153228964338181824 time 0.065536 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -7394439838318485025 time 0.07168 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 6629944304117643200 Time: 0.064512 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_401 (CudaConvolution) [06/13/2021-16:49:17] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_401 (CudaDepthwiseConvolution) [06/13/2021-16:49:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_401 (CublasConvolution) [06/13/2021-16:49:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6629944304117643200 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.016384 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.021504 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.016384 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.0256 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.0256 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.033792 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.023552 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [06/13/2021-16:49:17] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_260, Tanh_261), Mul_262) (PointWise) [06/13/2021-16:49:17] [V] [TRT] Tactic: 128 time 0.037888 [06/13/2021-16:49:17] [V] [TRT] Tactic: 256 time 0.037888 [06/13/2021-16:49:17] [V] [TRT] Tactic: 512 time 0.037888 [06/13/2021-16:49:17] [V] [TRT] Tactic: -32 time 0.057344 [06/13/2021-16:49:17] [V] [TRT] Tactic: -64 time 0.044032 [06/13/2021-16:49:17] [V] [TRT] Tactic: -128 time 0.043008 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 128 Time: 0.037888 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_260, Tanh_261), Mul_262) (PointWiseV2) [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.013312 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1 time 0.011264 [06/13/2021-16:49:17] [V] [TRT] Tactic: 2 time 0.01024 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3 time 0.01024 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4 time 0.009216 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5 time 0.009216 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6 time 0.011264 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7 time 0.009216 [06/13/2021-16:49:17] [V] [TRT] Tactic: 8 time 0.008192 [06/13/2021-16:49:17] [V] [TRT] Tactic: 9 time 0.008192 [06/13/2021-16:49:17] [V] [TRT] Tactic: 28 time 0.012288 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 8 Time: 0.008192 [06/13/2021-16:49:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [06/13/2021-16:49:17] [V] [TRT] [06/13/2021-16:49:17] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_260, Tanh_261), Mul_262) (PointWise) [06/13/2021-16:49:17] [V] [TRT] Tactic: 128 time 0.036864 [06/13/2021-16:49:17] [V] [TRT] Tactic: 256 time 0.037888 [06/13/2021-16:49:17] [V] [TRT] Tactic: 512 time 0.037888 [06/13/2021-16:49:17] [V] [TRT] Tactic: -32 time 0.058368 [06/13/2021-16:49:17] [V] [TRT] Tactic: -64 time 0.044032 [06/13/2021-16:49:17] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 128 Time: 0.036864 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_260, Tanh_261), Mul_262) (PointWiseV2) [06/13/2021-16:49:17] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:17] [V] [TRT] [06/13/2021-16:49:17] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,8192) -> Float(1,16,256:32,8192) *************** [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_260, Tanh_261), Mul_262) (PointWise) [06/13/2021-16:49:17] [V] [TRT] Tactic: 128 time 0.036864 [06/13/2021-16:49:17] [V] [TRT] Tactic: 256 time 0.037888 [06/13/2021-16:49:17] [V] [TRT] Tactic: 512 time 0.037888 [06/13/2021-16:49:17] [V] [TRT] Tactic: -32 time 0.057344 [06/13/2021-16:49:17] [V] [TRT] Tactic: -64 time 0.043008 [06/13/2021-16:49:17] [V] [TRT] Tactic: -128 time 0.041984 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 128 Time: 0.036864 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_260, Tanh_261), Mul_262) (PointWiseV2) [06/13/2021-16:49:17] [V] [TRT] Tactic: 24 time 0.013312 [06/13/2021-16:49:17] [V] [TRT] Tactic: 25 time 0.014336 [06/13/2021-16:49:17] [V] [TRT] Tactic: 26 time 0.014336 [06/13/2021-16:49:17] [V] [TRT] Tactic: 27 time 0.01536 [06/13/2021-16:49:17] [V] [TRT] Tactic: 31 time 0.013312 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 24 Time: 0.013312 [06/13/2021-16:49:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:17] [V] [TRT] [06/13/2021-16:49:17] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_263 || Conv_267 (FusedConvActConvolution) [06/13/2021-16:49:17] [V] [TRT] Tactic: 589823 time 0.366592 [06/13/2021-16:49:17] [V] [TRT] Tactic: 655359 time 0.22016 [06/13/2021-16:49:17] [V] [TRT] Tactic: 786431 time 0.355328 [06/13/2021-16:49:17] [V] [TRT] Tactic: 851967 time 0.297984 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1179647 time 0.21504 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1310719 time 0.538624 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1376255 time 0.234496 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1441791 time 0.443392 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1507327 time 0.325632 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1638399 time 0.376832 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1835007 time 0.28672 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1900543 time 0.415744 [06/13/2021-16:49:17] [V] [TRT] Tactic: 2097151 time 0.344064 [06/13/2021-16:49:17] [V] [TRT] Tactic: 2162687 time 0.260096 [06/13/2021-16:49:17] [V] [TRT] Tactic: 2293759 time 0.2304 [06/13/2021-16:49:17] [V] [TRT] Tactic: 2359295 time 0.259072 [06/13/2021-16:49:17] [V] [TRT] Tactic: 2686975 time 0.234496 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3080191 time 0.314368 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3342335 time 0.328704 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3407871 time 0.234496 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3538943 time 0.197632 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3670015 time 0.415744 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3932159 time 0.37888 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3997695 time 0.333824 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4063231 time 0.295936 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4194303 time 0.311296 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4259839 time 0.253952 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4325375 time 0.350208 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4521983 time 0.299008 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4587519 time 0.285696 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4653055 time 0.257024 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4915199 time 0.296928 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4980735 time 0.31744 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5177343 time 0.22016 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5242879 time 0.242688 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5373951 time 0.22528 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5439487 time 0.315392 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5570559 time 0.323584 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5636095 time 0.295936 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5701631 time 0.226304 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5767167 time 0.59392 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5832703 time 0.226304 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5898239 time 0.234496 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6029311 time 0.243712 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6225919 time 0.257024 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6291455 time 0.21504 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6422527 time 0.3072 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6750207 time 0.300032 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6815743 time 0.262144 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6946815 time 0.27136 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7012351 time 0.342016 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7077887 time 0.195584 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7143423 time 0.528384 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7208959 time 0.23552 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7340031 time 0.237568 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7405567 time 0.299008 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7536639 time 0.405504 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7602175 time 0.265216 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7733247 time 0.247808 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7798783 time 0.354304 [06/13/2021-16:49:17] [V] [TRT] Tactic: 8191999 time 0.339968 [06/13/2021-16:49:17] [V] [TRT] Tactic: 8257535 time 0.295936 [06/13/2021-16:49:17] [V] [TRT] Tactic: 8323071 time 0.292864 [06/13/2021-16:49:17] [V] [TRT] Tactic: 8650751 time 0.269312 [06/13/2021-16:49:17] [V] [TRT] Tactic: 8716287 time 0.272384 [06/13/2021-16:49:17] [V] [TRT] Tactic: 9109503 time 0.344064 [06/13/2021-16:49:17] [V] [TRT] Tactic: 9568255 time 0.29696 [06/13/2021-16:49:17] [V] [TRT] Tactic: 9895935 time 0.308224 [06/13/2021-16:49:17] [V] [TRT] Tactic: 10223615 time 0.233472 [06/13/2021-16:49:17] [V] [TRT] Tactic: 10354687 time 0.246784 [06/13/2021-16:49:17] [V] [TRT] Tactic: 10551295 time 0.304128 [06/13/2021-16:49:17] [V] [TRT] Tactic: 10747903 time 0.243712 [06/13/2021-16:49:17] [V] [TRT] Tactic: 10944511 time 0.319488 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 7077887 Time: 0.195584 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_263 || Conv_267 (CaskConvolution) [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1062367460111450758 time 0.160768 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1698681053543049347 time 0.137216 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4501471010995462441 time 0.169984 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5137655947464784826 time 0.13824 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5288347012147084929 time 0.165888 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5326823351883942011 time 0.164864 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5500448035057547314 time 0.14848 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6645123197870846056 time 0.142336 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7144526460361122478 time 0.144384 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: -8262349710178828730 time 0.167936 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -6576203419454146580 time 0.14336 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: -4787320710726427159 time 0.149504 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -3456450830548107839 time 0.152576 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: -1218658103698133241 time 0.157024 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: -836875257600482091 time 0.151552 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -410470605513481746 time 0.165888 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Tactic: -377491875521947884 time 0.165888 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -37215280111360163 time 0.13312 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.13312 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_263 || Conv_267 (CudaConvolution) [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.274432 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1 time 0.218112 [06/13/2021-16:49:17] [V] [TRT] Tactic: 2 time 0.3072 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2422472704, available: 524288000 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5 time 2.03264 [06/13/2021-16:49:17] [V] [TRT] Tactic: 56 time 0.272384 [06/13/2021-16:49:17] [V] [TRT] Tactic: 57 time 0.217088 [06/13/2021-16:49:17] [V] [TRT] Tactic: 58 time 0.3072 [06/13/2021-16:49:17] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2422472704, available: 524288000 [06/13/2021-16:49:17] [V] [TRT] Tactic: 61 time 2.0439 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 57 Time: 0.217088 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_263 || Conv_267 (CudaDepthwiseConvolution) [06/13/2021-16:49:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_263 || Conv_267 (CublasConvolution) [06/13/2021-16:49:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:17] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_263 || Conv_267 (FusedConvActConvolution) [06/13/2021-16:49:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_263 || Conv_267 (CaskConvolution) [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3886731678879822788 time 0.134144 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6629944304117643200 time 0.11264 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -9153228964338181824 time 0.115712 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Tactic: -7394439838318485025 time 0.134144 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 6629944304117643200 Time: 0.11264 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_263 || Conv_267 (CudaConvolution) [06/13/2021-16:49:17] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_263 || Conv_267 (CudaDepthwiseConvolution) [06/13/2021-16:49:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: Conv_263 || Conv_267 (CublasConvolution) [06/13/2021-16:49:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6629944304117643200 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.016384 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.02048 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.02048 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.016384 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.026624 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.026624 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.012288 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.019456 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:17] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [06/13/2021-16:49:17] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_268, Tanh_269), Mul_270) (PointWise) [06/13/2021-16:49:17] [V] [TRT] Tactic: 128 time 0.022528 [06/13/2021-16:49:17] [V] [TRT] Tactic: 256 time 0.022528 [06/13/2021-16:49:17] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:17] [V] [TRT] Tactic: -32 time 0.049152 [06/13/2021-16:49:17] [V] [TRT] Tactic: -64 time 0.029696 [06/13/2021-16:49:17] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 128 Time: 0.022528 [06/13/2021-16:49:17] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_268, Tanh_269), Mul_270) (PointWiseV2) [06/13/2021-16:49:17] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:17] [V] [TRT] Tactic: 1 time 0.007168 [06/13/2021-16:49:17] [V] [TRT] Tactic: 2 time 0.007168 [06/13/2021-16:49:17] [V] [TRT] Tactic: 3 time 0.007168 [06/13/2021-16:49:17] [V] [TRT] Tactic: 4 time 0.007168 [06/13/2021-16:49:17] [V] [TRT] Tactic: 5 time 0.006144 [06/13/2021-16:49:17] [V] [TRT] Tactic: 6 time 0.006144 [06/13/2021-16:49:17] [V] [TRT] Tactic: 7 time 0.006144 [06/13/2021-16:49:17] [V] [TRT] Tactic: 8 time 0.00512 [06/13/2021-16:49:17] [V] [TRT] Tactic: 9 time 0.006144 [06/13/2021-16:49:17] [V] [TRT] Tactic: 28 time 0.009216 [06/13/2021-16:49:17] [V] [TRT] Fastest Tactic: 8 Time: 0.00512 [06/13/2021-16:49:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [06/13/2021-16:49:17] [V] [TRT] [06/13/2021-16:49:18] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_268, Tanh_269), Mul_270) (PointWise) [06/13/2021-16:49:18] [V] [TRT] Tactic: 128 time 0.023552 [06/13/2021-16:49:18] [V] [TRT] Tactic: 256 time 0.023552 [06/13/2021-16:49:18] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:18] [V] [TRT] Tactic: -32 time 0.029696 [06/13/2021-16:49:18] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:18] [V] [TRT] Tactic: -128 time 0.022528 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: -128 Time: 0.022528 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_268, Tanh_269), Mul_270) (PointWiseV2) [06/13/2021-16:49:18] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: -128 [06/13/2021-16:49:18] [V] [TRT] [06/13/2021-16:49:18] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,8192) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_268, Tanh_269), Mul_270) (PointWise) [06/13/2021-16:49:18] [V] [TRT] Tactic: 128 time 0.022528 [06/13/2021-16:49:18] [V] [TRT] Tactic: 256 time 0.022528 [06/13/2021-16:49:18] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:18] [V] [TRT] Tactic: -32 time 0.049152 [06/13/2021-16:49:18] [V] [TRT] Tactic: -64 time 0.029696 [06/13/2021-16:49:18] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 128 Time: 0.022528 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_268, Tanh_269), Mul_270) (PointWiseV2) [06/13/2021-16:49:18] [V] [TRT] Tactic: 24 time 0.007168 [06/13/2021-16:49:18] [V] [TRT] Tactic: 25 time 0.006144 [06/13/2021-16:49:18] [V] [TRT] Tactic: 26 time 0.008192 [06/13/2021-16:49:18] [V] [TRT] Tactic: 27 time 0.012288 [06/13/2021-16:49:18] [V] [TRT] Tactic: 31 time 0.007168 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 25 Time: 0.006144 [06/13/2021-16:49:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [06/13/2021-16:49:18] [V] [TRT] [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.012288 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.019456 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.014304 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.011072 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 0 Time: 0.011072 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.009152 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.009152 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.019456 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [06/13/2021-16:49:18] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_271 (FusedConvActConvolution) [06/13/2021-16:49:18] [V] [TRT] Tactic: 589823 time 0.146432 [06/13/2021-16:49:18] [V] [TRT] Tactic: 655359 time 0.090112 [06/13/2021-16:49:18] [V] [TRT] Tactic: 786431 time 0.098304 [06/13/2021-16:49:18] [V] [TRT] Tactic: 851967 time 0.067584 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1179647 time 0.053248 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1310719 time 0.160768 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1376255 time 0.094208 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1441791 time 0.093184 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1507327 time 0.084992 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1638399 time 0.090112 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1835007 time 0.091136 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1900543 time 0.094208 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2097151 time 0.089088 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2162687 time 0.106496 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2293759 time 0.09728 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2359295 time 0.070656 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2686975 time 0.09728 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3080191 time 0.080896 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3342335 time 0.083968 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3407871 time 0.063488 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3538943 time 0.055296 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3670015 time 0.166912 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3932159 time 0.08704 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3997695 time 0.095232 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4063231 time 0.073728 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4194303 time 0.088064 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4259839 time 0.068608 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4325375 time 0.08704 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4521983 time 0.103424 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4587519 time 0.078848 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4653055 time 0.06144 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4915199 time 0.082944 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4980735 time 0.084992 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5177343 time 0.055296 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5242879 time 0.067584 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5373951 time 0.055296 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5439487 time 0.091136 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5570559 time 0.082944 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5636095 time 0.072704 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5701631 time 0.093184 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5767167 time 0.156672 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5832703 time 0.06144 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5898239 time 0.064512 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6029311 time 0.094208 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6225919 time 0.063488 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6291455 time 0.053248 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6422527 time 0.077824 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6750207 time 0.08192 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6815743 time 0.070656 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6946815 time 0.08192 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7012351 time 0.089088 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7077887 time 0.054272 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7143423 time 0.13312 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7208959 time 0.062464 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7340031 time 0.065536 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7405567 time 0.074752 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7536639 time 0.101376 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7602175 time 0.080896 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7733247 time 0.060416 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7798783 time 0.100352 [06/13/2021-16:49:18] [V] [TRT] Tactic: 8191999 time 0.110592 [06/13/2021-16:49:18] [V] [TRT] Tactic: 8257535 time 0.08704 [06/13/2021-16:49:18] [V] [TRT] Tactic: 8323071 time 0.090112 [06/13/2021-16:49:18] [V] [TRT] Tactic: 8650751 time 0.083968 [06/13/2021-16:49:18] [V] [TRT] Tactic: 8716287 time 0.069632 [06/13/2021-16:49:18] [V] [TRT] Tactic: 9109503 time 0.089088 [06/13/2021-16:49:18] [V] [TRT] Tactic: 9568255 time 0.08192 [06/13/2021-16:49:18] [V] [TRT] Tactic: 9895935 time 0.09216 [06/13/2021-16:49:18] [V] [TRT] Tactic: 10223615 time 0.09728 [06/13/2021-16:49:18] [V] [TRT] Tactic: 10354687 time 0.065536 [06/13/2021-16:49:18] [V] [TRT] Tactic: 10551295 time 0.086016 [06/13/2021-16:49:18] [V] [TRT] Tactic: 10747903 time 0.059392 [06/13/2021-16:49:18] [V] [TRT] Tactic: 10944511 time 0.084992 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 1179647 Time: 0.053248 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_271 (CaskConvolution) [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1062367460111450758 time 0.06656 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1698681053543049347 time 0.055296 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4501471010995462441 time 0.055296 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5137655947464784826 time 0.0512 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5288347012147084929 time 0.054272 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5326823351883942011 time 0.052224 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5500448035057547314 time 0.063488 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6645123197870846056 time 0.054272 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7144526460361122478 time 0.057344 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Tactic: -8262349710178828730 time 0.05632 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: -6576203419454146580 time 0.058368 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Tactic: -4787320710726427159 time 0.058368 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: -3456450830548107839 time 0.06144 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Tactic: -1218658103698133241 time 0.067584 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Tactic: -836875257600482091 time 0.063488 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: -410470605513481746 time 0.053248 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Tactic: -377491875521947884 time 0.054272 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: -37215280111360163 time 0.050176 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.050176 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_271 (CudaConvolution) [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.079872 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1 time 0.064512 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2 time 0.15872 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4 skipped. Scratch requested: 606208000, available: 524288000 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5 time 0.600864 [06/13/2021-16:49:18] [V] [TRT] Tactic: 56 time 0.078848 [06/13/2021-16:49:18] [V] [TRT] Tactic: 57 time 0.065536 [06/13/2021-16:49:18] [V] [TRT] Tactic: 58 time 0.15872 [06/13/2021-16:49:18] [V] [TRT] Tactic: 60 skipped. Scratch requested: 606208000, available: 524288000 [06/13/2021-16:49:18] [V] [TRT] Tactic: 61 time 0.607232 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 1 Time: 0.064512 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_271 (CudaDepthwiseConvolution) [06/13/2021-16:49:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_271 (CublasConvolution) [06/13/2021-16:49:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:18] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_271 (FusedConvActConvolution) [06/13/2021-16:49:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_271 (CaskConvolution) [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3886731678879822788 time 0.04608 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6629944304117643200 time 0.04096 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: -9153228964338181824 time 0.04096 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Tactic: -7394439838318485025 time 0.047104 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 6629944304117643200 Time: 0.04096 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_271 (CudaConvolution) [06/13/2021-16:49:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_271 (CudaDepthwiseConvolution) [06/13/2021-16:49:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_271 (CublasConvolution) [06/13/2021-16:49:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6629944304117643200 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.012288 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:18] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [06/13/2021-16:49:18] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_272, Tanh_273), Mul_274) (PointWise) [06/13/2021-16:49:18] [V] [TRT] Tactic: 128 time 0.02048 [06/13/2021-16:49:18] [V] [TRT] Tactic: 256 time 0.02048 [06/13/2021-16:49:18] [V] [TRT] Tactic: 512 time 0.021504 [06/13/2021-16:49:18] [V] [TRT] Tactic: -32 time 0.049152 [06/13/2021-16:49:18] [V] [TRT] Tactic: -64 time 0.029696 [06/13/2021-16:49:18] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 128 Time: 0.02048 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_272, Tanh_273), Mul_274) (PointWiseV2) [06/13/2021-16:49:18] [V] [TRT] Tactic: 0 time 0.008192 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1 time 0.007168 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2 time 0.006144 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3 time 0.006144 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4 time 0.006144 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5 time 0.006144 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6 time 0.006144 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7 time 0.00512 [06/13/2021-16:49:18] [V] [TRT] Tactic: 8 time 0.00512 [06/13/2021-16:49:18] [V] [TRT] Tactic: 9 time 0.00512 [06/13/2021-16:49:18] [V] [TRT] Tactic: 28 time 0.008192 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 7 Time: 0.00512 [06/13/2021-16:49:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [06/13/2021-16:49:18] [V] [TRT] [06/13/2021-16:49:18] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_272, Tanh_273), Mul_274) (PointWise) [06/13/2021-16:49:18] [V] [TRT] Tactic: 128 time 0.02048 [06/13/2021-16:49:18] [V] [TRT] Tactic: 256 time 0.02048 [06/13/2021-16:49:18] [V] [TRT] Tactic: 512 time 0.021504 [06/13/2021-16:49:18] [V] [TRT] Tactic: -32 time 0.049152 [06/13/2021-16:49:18] [V] [TRT] Tactic: -64 time 0.029696 [06/13/2021-16:49:18] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 128 Time: 0.02048 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_272, Tanh_273), Mul_274) (PointWiseV2) [06/13/2021-16:49:18] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:18] [V] [TRT] [06/13/2021-16:49:18] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_272, Tanh_273), Mul_274) (PointWise) [06/13/2021-16:49:18] [V] [TRT] Tactic: 128 time 0.02048 [06/13/2021-16:49:18] [V] [TRT] Tactic: 256 time 0.02048 [06/13/2021-16:49:18] [V] [TRT] Tactic: 512 time 0.02048 [06/13/2021-16:49:18] [V] [TRT] Tactic: -32 time 0.049152 [06/13/2021-16:49:18] [V] [TRT] Tactic: -64 time 0.029696 [06/13/2021-16:49:18] [V] [TRT] Tactic: -128 time 0.022528 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 128 Time: 0.02048 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_272, Tanh_273), Mul_274) (PointWiseV2) [06/13/2021-16:49:18] [V] [TRT] Tactic: 24 time 0.007168 [06/13/2021-16:49:18] [V] [TRT] Tactic: 25 time 0.006144 [06/13/2021-16:49:18] [V] [TRT] Tactic: 26 time 0.008192 [06/13/2021-16:49:18] [V] [TRT] Tactic: 27 time 0.012288 [06/13/2021-16:49:18] [V] [TRT] Tactic: 31 time 0.007168 [06/13/2021-16:49:18] [V] [TRT] Fastest Tactic: 25 Time: 0.006144 [06/13/2021-16:49:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [06/13/2021-16:49:18] [V] [TRT] [06/13/2021-16:49:18] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:18] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:18] [V] [TRT] --------------- Timing Runner: Conv_275 (FusedConvActConvolution) [06/13/2021-16:49:18] [V] [TRT] Tactic: 524287 time 0.411648 [06/13/2021-16:49:18] [V] [TRT] Tactic: 720895 time 0.365568 [06/13/2021-16:49:18] [V] [TRT] Tactic: 983039 time 0.31232 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1048575 time 0.346112 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1703935 time 0.33792 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1769471 time 0.475136 [06/13/2021-16:49:18] [V] [TRT] Tactic: 1966079 time 0.475136 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2031615 time 0.493568 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2228223 time 0.315392 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2424831 time 0.439296 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2621439 time 0.309248 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2752511 time 0.446464 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2818047 time 0.553984 [06/13/2021-16:49:18] [V] [TRT] Tactic: 2883583 time 0.595968 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3014655 time 0.314368 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3145727 time 0.393216 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3473407 time 0.380928 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3604479 time 0.309248 [06/13/2021-16:49:18] [V] [TRT] Tactic: 3735551 time 0.330752 [06/13/2021-16:49:18] [V] [TRT] Tactic: 4390911 time 0.529408 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5046271 time 0.342016 [06/13/2021-16:49:18] [V] [TRT] Tactic: 5963775 time 0.412672 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6160383 time 0.395264 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6488063 time 0.498688 [06/13/2021-16:49:18] [V] [TRT] Tactic: 6881279 time 0.412672 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7274495 time 0.382976 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7864319 time 0.387072 [06/13/2021-16:49:18] [V] [TRT] Tactic: 7995391 time 0.324608 [06/13/2021-16:49:18] [V] [TRT] Tactic: 8585215 time 0.497664 [06/13/2021-16:49:18] [V] [TRT] Tactic: 8847359 time 0.421888 [06/13/2021-16:49:18] [V] [TRT] Tactic: 8978431 time 0.42496 [06/13/2021-16:49:18] [V] [TRT] Tactic: 9043967 time 0.416768 [06/13/2021-16:49:18] [V] [TRT] Tactic: 9175039 time 0.310272 [06/13/2021-16:49:18] [V] [TRT] Tactic: 9502719 time 0.52736 [06/13/2021-16:49:18] [V] [TRT] Tactic: 9830399 time 0.34816 [06/13/2021-16:49:18] [V] [TRT] Tactic: 9961471 time 0.340992 [06/13/2021-16:49:18] [V] [TRT] Tactic: 10027007 time 0.46592 [06/13/2021-16:49:18] [V] [TRT] Tactic: 10092543 time 0.53248 [06/13/2021-16:49:18] [V] [TRT] Tactic: 10289151 time 0.474112 [06/13/2021-16:49:18] [V] [TRT] Tactic: 10485759 time 0.41984 [06/13/2021-16:49:19] [V] [TRT] Tactic: 10682367 time 0.308224 [06/13/2021-16:49:19] [V] [TRT] Tactic: 10813439 time 0.288768 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 10813439 Time: 0.288768 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: Conv_275 (CaskConvolution) [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1062367460111450758 time 0.600064 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1754984623894446479 time 0.536576 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3611739942397549984 time 0.493568 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3827454225649558724 time 0.16384 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: 4337000649858996379 time 0.477184 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: 4501471010995462441 time 0.489472 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: 5137655947464784826 time 0.401408 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: 5288347012147084929 time 0.468192 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: 5921334924264294896 time 0.175104 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: 6645123197870846056 time 0.456704 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: 7144526460361122478 time 0.489472 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: 7852627285308570038 time 0.172032 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: -9137461792520977713 time 0.526336 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: -8776506421218919509 time 0.159744 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: -8262349710178828730 time 0.473088 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: -8133971918129952780 time 0.592896 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: -6092040395344634144 time 0.644096 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: -4787320710726427159 time 0.540672 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: -3456450830548107839 time 0.4864 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: -2318106587342035239 time 0.16896 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: -1343271414618805657 time 0.159744 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: -1218658103698133241 time 0.586752 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Tactic: -836875257600482091 time 0.54272 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: -410470605513481746 time 0.47408 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: -8776506421218919509 Time: 0.159744 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: Conv_275 (CudaConvolution) [06/13/2021-16:49:19] [V] [TRT] Tactic: 0 time 0.559104 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1 time 0.899072 [06/13/2021-16:49:19] [V] [TRT] Tactic: 2 time 0.485376 [06/13/2021-16:49:19] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2295595008, available: 524288000 [06/13/2021-16:49:19] [V] [TRT] Tactic: 5 skipped. Scratch requested: 1145307136, available: 524288000 [06/13/2021-16:49:19] [V] [TRT] Tactic: 6 time 0.30208 [06/13/2021-16:49:19] [V] [TRT] Tactic: 56 time 0.565248 [06/13/2021-16:49:19] [V] [TRT] Tactic: 57 time 0.892672 [06/13/2021-16:49:19] [V] [TRT] Tactic: 58 time 0.484352 [06/13/2021-16:49:19] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2295595008, available: 524288000 [06/13/2021-16:49:19] [V] [TRT] Tactic: 61 skipped. Scratch requested: 1145307136, available: 524288000 [06/13/2021-16:49:19] [V] [TRT] Tactic: 62 time 0.305152 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 6 Time: 0.30208 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: Conv_275 (CudaDepthwiseConvolution) [06/13/2021-16:49:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: Conv_275 (CublasConvolution) [06/13/2021-16:49:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8776506421218919509 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: Conv_275 (FusedConvActConvolution) [06/13/2021-16:49:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: Conv_275 (CaskConvolution) [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: -9153228964338181824 time 0.285696 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:19] [V] [TRT] Tactic: -7394439838318485025 time 0.35328 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.285696 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: Conv_275 (CudaConvolution) [06/13/2021-16:49:19] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: Conv_275 (CudaDepthwiseConvolution) [06/13/2021-16:49:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: Conv_275 (CublasConvolution) [06/13/2021-16:49:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_275 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072), Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_276, Tanh_277), Mul_278), Add_279) (PointWise) [06/13/2021-16:49:19] [V] [TRT] Tactic: 128 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: 256 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -32 time 0.05632 [06/13/2021-16:49:19] [V] [TRT] Tactic: -64 time 0.033792 [06/13/2021-16:49:19] [V] [TRT] Tactic: -128 time 0.0256 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 128 Time: 0.023552 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_276, Tanh_277), Mul_278), Add_279) (PointWiseV2) [06/13/2021-16:49:19] [V] [TRT] Tactic: 0 time 0.008192 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 2 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 4 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 5 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 6 time 0.006112 [06/13/2021-16:49:19] [V] [TRT] Tactic: 7 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 8 time 0.00512 [06/13/2021-16:49:19] [V] [TRT] Tactic: 9 time 0.006112 [06/13/2021-16:49:19] [V] [TRT] Tactic: 28 time 0.008192 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 8 Time: 0.00512 [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072), Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_276, Tanh_277), Mul_278), Add_279) (PointWise) [06/13/2021-16:49:19] [V] [TRT] Tactic: 128 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: 256 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -32 time 0.05632 [06/13/2021-16:49:19] [V] [TRT] Tactic: -64 time 0.033792 [06/13/2021-16:49:19] [V] [TRT] Tactic: -128 time 0.026624 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 128 Time: 0.023552 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_276, Tanh_277), Mul_278), Add_279) (PointWiseV2) [06/13/2021-16:49:19] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096), Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_276, Tanh_277), Mul_278), Add_279) (PointWise) [06/13/2021-16:49:19] [V] [TRT] Tactic: 128 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: 256 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -32 time 0.05632 [06/13/2021-16:49:19] [V] [TRT] Tactic: -64 time 0.033792 [06/13/2021-16:49:19] [V] [TRT] Tactic: -128 time 0.0256 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 128 Time: 0.023552 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(PWN(Softplus_276, Tanh_277), Mul_278), Add_279) (PointWiseV2) [06/13/2021-16:49:19] [V] [TRT] Tactic: 24 time 0.011264 [06/13/2021-16:49:19] [V] [TRT] Tactic: 25 time 0.009216 [06/13/2021-16:49:19] [V] [TRT] Tactic: 26 time 0.01024 [06/13/2021-16:49:19] [V] [TRT] Tactic: 27 time 0.013312 [06/13/2021-16:49:19] [V] [TRT] Tactic: 31 time 0.01024 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 25 Time: 0.009216 [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072), Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072), Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096), Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072), Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072), Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096), Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072), Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072), Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096), Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_264, Tanh_265), Mul_266) (PointWise) [06/13/2021-16:49:19] [V] [TRT] Tactic: 128 time 0.022528 [06/13/2021-16:49:19] [V] [TRT] Tactic: 256 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -32 time 0.049152 [06/13/2021-16:49:19] [V] [TRT] Tactic: -64 time 0.029696 [06/13/2021-16:49:19] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 128 Time: 0.022528 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_264, Tanh_265), Mul_266) (PointWiseV2) [06/13/2021-16:49:19] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1 time 0.008192 [06/13/2021-16:49:19] [V] [TRT] Tactic: 2 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 4 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 5 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 6 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 7 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 8 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 9 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 28 time 0.009216 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 5 Time: 0.006144 [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_264, Tanh_265), Mul_266) (PointWise) [06/13/2021-16:49:19] [V] [TRT] Tactic: 128 time 0.022528 [06/13/2021-16:49:19] [V] [TRT] Tactic: 256 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -32 time 0.029696 [06/13/2021-16:49:19] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 128 Time: 0.022528 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_264, Tanh_265), Mul_266) (PointWiseV2) [06/13/2021-16:49:19] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,8192) -> Float(1,16,256:32,8192) *************** [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_264, Tanh_265), Mul_266) (PointWise) [06/13/2021-16:49:19] [V] [TRT] Tactic: 128 time 0.022528 [06/13/2021-16:49:19] [V] [TRT] Tactic: 256 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -32 time 0.049152 [06/13/2021-16:49:19] [V] [TRT] Tactic: -64 time 0.03072 [06/13/2021-16:49:19] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 128 Time: 0.022528 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_264, Tanh_265), Mul_266) (PointWiseV2) [06/13/2021-16:49:19] [V] [TRT] Tactic: 24 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 25 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 26 time 0.008192 [06/13/2021-16:49:19] [V] [TRT] Tactic: 27 time 0.012288 [06/13/2021-16:49:19] [V] [TRT] Tactic: 31 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 25 Time: 0.006144 [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:19] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:19] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:19] [V] [TRT] Tactic: 1002 time 0.012288 [06/13/2021-16:49:19] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:19] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:19] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:19] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:19] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:19] [V] [TRT] Tactic: 1002 time 0.019456 [06/13/2021-16:49:19] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:19] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:19] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_308, Tanh_309), Mul_310) (PointWise) [06/13/2021-16:49:19] [V] [TRT] Tactic: 128 time 0.022528 [06/13/2021-16:49:19] [V] [TRT] Tactic: 256 time 0.022528 [06/13/2021-16:49:19] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -32 time 0.049152 [06/13/2021-16:49:19] [V] [TRT] Tactic: -64 time 0.029696 [06/13/2021-16:49:19] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 128 Time: 0.022528 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_308, Tanh_309), Mul_310) (PointWiseV2) [06/13/2021-16:49:19] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 2 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 4 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 5 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 6 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 7 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 8 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 9 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 28 time 0.009216 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 5 Time: 0.006144 [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_308, Tanh_309), Mul_310) (PointWise) [06/13/2021-16:49:19] [V] [TRT] Tactic: 128 time 0.022528 [06/13/2021-16:49:19] [V] [TRT] Tactic: 256 time 0.022528 [06/13/2021-16:49:19] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -32 time 0.029696 [06/13/2021-16:49:19] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 128 Time: 0.022528 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_308, Tanh_309), Mul_310) (PointWiseV2) [06/13/2021-16:49:19] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,8192) *************** [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_308, Tanh_309), Mul_310) (PointWise) [06/13/2021-16:49:19] [V] [TRT] Tactic: 128 time 0.022528 [06/13/2021-16:49:19] [V] [TRT] Tactic: 256 time 0.022528 [06/13/2021-16:49:19] [V] [TRT] Tactic: 512 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Tactic: -32 time 0.049152 [06/13/2021-16:49:19] [V] [TRT] Tactic: -64 time 0.029696 [06/13/2021-16:49:19] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 128 Time: 0.022528 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: PWN(PWN(Softplus_308, Tanh_309), Mul_310) (PointWiseV2) [06/13/2021-16:49:19] [V] [TRT] Tactic: 24 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Tactic: 25 time 0.006144 [06/13/2021-16:49:19] [V] [TRT] Tactic: 26 time 0.008192 [06/13/2021-16:49:19] [V] [TRT] Tactic: 27 time 0.012288 [06/13/2021-16:49:19] [V] [TRT] Tactic: 31 time 0.007168 [06/13/2021-16:49:19] [V] [TRT] Fastest Tactic: 25 Time: 0.006144 [06/13/2021-16:49:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [06/13/2021-16:49:19] [V] [TRT] [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,8192) -> Float(1,16,256:32,8192) *************** [06/13/2021-16:49:19] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:19] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:19] [V] [TRT] --------------- Timing Runner: Conv_316 (FusedConvActConvolution) [06/13/2021-16:49:19] [V] [TRT] Tactic: 589823 time 0.33792 [06/13/2021-16:49:19] [V] [TRT] Tactic: 655359 time 0.203776 [06/13/2021-16:49:19] [V] [TRT] Tactic: 786431 time 0.178176 [06/13/2021-16:49:19] [V] [TRT] Tactic: 851967 time 0.167936 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1179647 time 0.1024 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1310719 time 0.30208 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1376255 time 0.208896 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1441791 time 0.216064 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1507327 time 0.20992 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1638399 time 0.19968 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1835007 time 0.171008 [06/13/2021-16:49:19] [V] [TRT] Tactic: 1900543 time 0.210944 [06/13/2021-16:49:19] [V] [TRT] Tactic: 2097151 time 0.166912 [06/13/2021-16:49:19] [V] [TRT] Tactic: 2162687 time 0.21504 [06/13/2021-16:49:19] [V] [TRT] Tactic: 2293759 time 0.206848 [06/13/2021-16:49:19] [V] [TRT] Tactic: 2359295 time 0.13312 [06/13/2021-16:49:19] [V] [TRT] Tactic: 2686975 time 0.206848 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3080191 time 0.202752 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3342335 time 0.20992 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3407871 time 0.119808 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3538943 time 0.119808 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3670015 time 0.401408 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3932159 time 0.18944 [06/13/2021-16:49:19] [V] [TRT] Tactic: 3997695 time 0.178176 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4063231 time 0.165888 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4194303 time 0.176128 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4259839 time 0.125952 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4325375 time 0.159744 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4521983 time 0.208896 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4587519 time 0.141312 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4653055 time 0.131072 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4915199 time 0.150528 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4980735 time 0.155648 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5177343 time 0.105472 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5242879 time 0.128 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5373951 time 0.10752 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5439487 time 0.180224 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5570559 time 0.207872 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5636095 time 0.165888 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5701631 time 0.198656 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5767167 time 0.310272 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5832703 time 0.116736 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5898239 time 0.131072 [06/13/2021-16:49:20] [V] [TRT] Tactic: 6029311 time 0.200704 [06/13/2021-16:49:20] [V] [TRT] Tactic: 6225919 time 0.124928 [06/13/2021-16:49:20] [V] [TRT] Tactic: 6291455 time 0.104448 [06/13/2021-16:49:20] [V] [TRT] Tactic: 6422527 time 0.196608 [06/13/2021-16:49:20] [V] [TRT] Tactic: 6750207 time 0.150528 [06/13/2021-16:49:20] [V] [TRT] Tactic: 6815743 time 0.131072 [06/13/2021-16:49:20] [V] [TRT] Tactic: 6946815 time 0.166912 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7012351 time 0.165888 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7077887 time 0.114688 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7143423 time 0.25088 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7208959 time 0.116736 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7340031 time 0.132096 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7405567 time 0.169984 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7536639 time 0.201728 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7602175 time 0.16384 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7733247 time 0.119808 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7798783 time 0.182272 [06/13/2021-16:49:20] [V] [TRT] Tactic: 8191999 time 0.212992 [06/13/2021-16:49:20] [V] [TRT] Tactic: 8257535 time 0.150528 [06/13/2021-16:49:20] [V] [TRT] Tactic: 8323071 time 0.172032 [06/13/2021-16:49:20] [V] [TRT] Tactic: 8650751 time 0.169984 [06/13/2021-16:49:20] [V] [TRT] Tactic: 8716287 time 0.132096 [06/13/2021-16:49:20] [V] [TRT] Tactic: 9109503 time 0.165888 [06/13/2021-16:49:20] [V] [TRT] Tactic: 9568255 time 0.150528 [06/13/2021-16:49:20] [V] [TRT] Tactic: 9895935 time 0.176128 [06/13/2021-16:49:20] [V] [TRT] Tactic: 10223615 time 0.207872 [06/13/2021-16:49:20] [V] [TRT] Tactic: 10354687 time 0.120832 [06/13/2021-16:49:20] [V] [TRT] Tactic: 10551295 time 0.155648 [06/13/2021-16:49:20] [V] [TRT] Tactic: 10747903 time 0.119808 [06/13/2021-16:49:20] [V] [TRT] Tactic: 10944511 time 0.155648 [06/13/2021-16:49:20] [V] [TRT] Fastest Tactic: 1179647 Time: 0.1024 [06/13/2021-16:49:20] [V] [TRT] --------------- Timing Runner: Conv_316 (CaskConvolution) [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: 1062367460111450758 time 0.125952 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Tactic: 1698681053543049347 time 0.11264 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4501471010995462441 time 0.105472 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5137655947464784826 time 0.095232 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5288347012147084929 time 0.106496 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5326823351883942011 time 0.1024 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5500448035057547314 time 0.132096 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: 6645123197870846056 time 0.099328 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Tactic: 7144526460361122478 time 0.11776 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Tactic: -8262349710178828730 time 0.108544 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: -6576203419454146580 time 0.108544 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Tactic: -4787320710726427159 time 0.123904 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: -3456450830548107839 time 0.114688 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Tactic: -1218658103698133241 time 0.139264 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Tactic: -836875257600482091 time 0.134144 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: -410470605513481746 time 0.104448 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Tactic: -377491875521947884 time 0.106496 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: -37215280111360163 time 0.093184 [06/13/2021-16:49:20] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.093184 [06/13/2021-16:49:20] [V] [TRT] --------------- Timing Runner: Conv_316 (CudaConvolution) [06/13/2021-16:49:20] [V] [TRT] Tactic: 0 time 0.147456 [06/13/2021-16:49:20] [V] [TRT] Tactic: 1 time 0.114688 [06/13/2021-16:49:20] [V] [TRT] Tactic: 2 time 0.2048 [06/13/2021-16:49:20] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1212416000, available: 524288000 [06/13/2021-16:49:20] [V] [TRT] Tactic: 5 time 1.20218 [06/13/2021-16:49:20] [V] [TRT] Tactic: 56 time 0.142336 [06/13/2021-16:49:20] [V] [TRT] Tactic: 57 time 0.114688 [06/13/2021-16:49:20] [V] [TRT] Tactic: 58 time 0.203776 [06/13/2021-16:49:20] [V] [TRT] Tactic: 60 skipped. Scratch requested: 1212416000, available: 524288000 [06/13/2021-16:49:20] [V] [TRT] Tactic: 61 time 1.17229 [06/13/2021-16:49:20] [V] [TRT] Fastest Tactic: 1 Time: 0.114688 [06/13/2021-16:49:20] [V] [TRT] --------------- Timing Runner: Conv_316 (CudaDepthwiseConvolution) [06/13/2021-16:49:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:20] [V] [TRT] --------------- Timing Runner: Conv_316 (CublasConvolution) [06/13/2021-16:49:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:20] [V] [TRT] [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:20] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] --------------- Timing Runner: Conv_316 (FusedConvActConvolution) [06/13/2021-16:49:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:20] [V] [TRT] --------------- Timing Runner: Conv_316 (CaskConvolution) [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: 3886731678879822788 time 0.082944 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: 6629944304117643200 time 0.07168 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: -9153228964338181824 time 0.07168 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Tactic: -7394439838318485025 time 0.083968 [06/13/2021-16:49:20] [V] [TRT] Fastest Tactic: 6629944304117643200 Time: 0.07168 [06/13/2021-16:49:20] [V] [TRT] --------------- Timing Runner: Conv_316 (CudaConvolution) [06/13/2021-16:49:20] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:20] [V] [TRT] --------------- Timing Runner: Conv_316 (CudaDepthwiseConvolution) [06/13/2021-16:49:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:20] [V] [TRT] --------------- Timing Runner: Conv_316 (CublasConvolution) [06/13/2021-16:49:20] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6629944304117643200 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:20] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:22] [V] [TRT] --------------- Timing Runner: LeakyRelu_317 (PointWise) [06/13/2021-16:49:22] [V] [TRT] Tactic: 128 time 0.012288 [06/13/2021-16:49:22] [V] [TRT] Tactic: 256 time 0.012288 [06/13/2021-16:49:22] [V] [TRT] Tactic: 512 time 0.012288 [06/13/2021-16:49:22] [V] [TRT] Tactic: -32 time 0.0256 [06/13/2021-16:49:22] [V] [TRT] Tactic: -64 time 0.016384 [06/13/2021-16:49:22] [V] [TRT] Tactic: -128 time 0.013312 [06/13/2021-16:49:22] [V] [TRT] Fastest Tactic: 128 Time: 0.012288 [06/13/2021-16:49:22] [V] [TRT] --------------- Timing Runner: LeakyRelu_317 (PointWiseV2) [06/13/2021-16:49:22] [V] [TRT] Tactic: 0 time 0.007168 [06/13/2021-16:49:22] [V] [TRT] Tactic: 1 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Tactic: 2 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Tactic: 3 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Tactic: 4 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Tactic: 5 time 0.004096 [06/13/2021-16:49:22] [V] [TRT] Tactic: 6 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Tactic: 7 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Tactic: 8 time 0.004096 [06/13/2021-16:49:22] [V] [TRT] Tactic: 9 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Tactic: 28 time 0.006144 [06/13/2021-16:49:22] [V] [TRT] Fastest Tactic: 5 Time: 0.004096 [06/13/2021-16:49:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [06/13/2021-16:49:22] [V] [TRT] [06/13/2021-16:49:22] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:22] [V] [TRT] --------------- Timing Runner: LeakyRelu_317 (PointWise) [06/13/2021-16:49:22] [V] [TRT] Tactic: 128 time 0.012288 [06/13/2021-16:49:22] [V] [TRT] Tactic: 256 time 0.011264 [06/13/2021-16:49:22] [V] [TRT] Tactic: 512 time 0.012288 [06/13/2021-16:49:22] [V] [TRT] Tactic: -32 time 0.0256 [06/13/2021-16:49:22] [V] [TRT] Tactic: -64 time 0.016384 [06/13/2021-16:49:22] [V] [TRT] Tactic: -128 time 0.013312 [06/13/2021-16:49:22] [V] [TRT] Fastest Tactic: 256 Time: 0.011264 [06/13/2021-16:49:22] [V] [TRT] --------------- Timing Runner: LeakyRelu_317 (PointWiseV2) [06/13/2021-16:49:22] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 256 [06/13/2021-16:49:22] [V] [TRT] [06/13/2021-16:49:22] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:22] [V] [TRT] --------------- Timing Runner: LeakyRelu_317 (PointWise) [06/13/2021-16:49:22] [V] [TRT] Tactic: 128 time 0.011264 [06/13/2021-16:49:22] [V] [TRT] Tactic: 256 time 0.012288 [06/13/2021-16:49:22] [V] [TRT] Tactic: 512 time 0.012288 [06/13/2021-16:49:22] [V] [TRT] Tactic: -32 time 0.0256 [06/13/2021-16:49:22] [V] [TRT] Tactic: -64 time 0.016384 [06/13/2021-16:49:22] [V] [TRT] Tactic: -128 time 0.012288 [06/13/2021-16:49:22] [V] [TRT] Fastest Tactic: 128 Time: 0.011264 [06/13/2021-16:49:22] [V] [TRT] --------------- Timing Runner: LeakyRelu_317 (PointWiseV2) [06/13/2021-16:49:22] [V] [TRT] Tactic: 24 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Tactic: 25 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Tactic: 26 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Tactic: 27 time 0.006144 [06/13/2021-16:49:22] [V] [TRT] Tactic: 31 time 0.00512 [06/13/2021-16:49:22] [V] [TRT] Fastest Tactic: 24 Time: 0.00512 [06/13/2021-16:49:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:22] [V] [TRT] [06/13/2021-16:49:22] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:22] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:22] [V] [TRT] --------------- Timing Runner: Conv_318 (FusedConvActConvolution) [06/13/2021-16:49:23] [V] [TRT] Tactic: 524287 time 0.687104 [06/13/2021-16:49:23] [V] [TRT] Tactic: 720895 time 0.693248 [06/13/2021-16:49:23] [V] [TRT] Tactic: 983039 time 0.669696 [06/13/2021-16:49:23] [V] [TRT] Tactic: 1048575 time 0.677504 [06/13/2021-16:49:23] [V] [TRT] Tactic: 1703935 time 0.65536 [06/13/2021-16:49:23] [V] [TRT] Tactic: 1769471 time 1.12128 [06/13/2021-16:49:23] [V] [TRT] Tactic: 1966079 time 0.619136 [06/13/2021-16:49:23] [V] [TRT] Tactic: 2031615 time 0.934912 [06/13/2021-16:49:23] [V] [TRT] Tactic: 2228223 time 0.6144 [06/13/2021-16:49:23] [V] [TRT] Tactic: 2424831 time 0.859776 [06/13/2021-16:49:23] [V] [TRT] Tactic: 2621439 time 0.673792 [06/13/2021-16:49:23] [V] [TRT] Tactic: 2752511 time 0.80384 [06/13/2021-16:49:23] [V] [TRT] Tactic: 2818047 time 1.13254 [06/13/2021-16:49:23] [V] [TRT] Tactic: 2883583 time 0.768 [06/13/2021-16:49:23] [V] [TRT] Tactic: 3014655 time 0.632832 [06/13/2021-16:49:23] [V] [TRT] Tactic: 3145727 time 0.804864 [06/13/2021-16:49:23] [V] [TRT] Tactic: 3473407 time 0.689152 [06/13/2021-16:49:23] [V] [TRT] Tactic: 3604479 time 0.621344 [06/13/2021-16:49:23] [V] [TRT] Tactic: 3735551 time 0.74752 [06/13/2021-16:49:23] [V] [TRT] Tactic: 4390911 time 0.892864 [06/13/2021-16:49:23] [V] [TRT] Tactic: 5046271 time 0.718656 [06/13/2021-16:49:23] [V] [TRT] Tactic: 5963775 time 0.692224 [06/13/2021-16:49:24] [V] [TRT] Tactic: 6160383 time 0.80384 [06/13/2021-16:49:24] [V] [TRT] Tactic: 6488063 time 0.833536 [06/13/2021-16:49:24] [V] [TRT] Tactic: 6881279 time 0.733952 [06/13/2021-16:49:24] [V] [TRT] Tactic: 7274495 time 0.93696 [06/13/2021-16:49:24] [V] [TRT] Tactic: 7864319 time 0.857088 [06/13/2021-16:49:24] [V] [TRT] Tactic: 7995391 time 0.577536 [06/13/2021-16:49:24] [V] [TRT] Tactic: 8585215 time 0.80896 [06/13/2021-16:49:24] [V] [TRT] Tactic: 8847359 time 0.889472 [06/13/2021-16:49:24] [V] [TRT] Tactic: 8978431 time 0.713344 [06/13/2021-16:49:24] [V] [TRT] Tactic: 9043967 time 0.804864 [06/13/2021-16:49:24] [V] [TRT] Tactic: 9175039 time 0.61952 [06/13/2021-16:49:24] [V] [TRT] Tactic: 9502719 time 0.888832 [06/13/2021-16:49:24] [V] [TRT] Tactic: 9830399 time 0.83968 [06/13/2021-16:49:24] [V] [TRT] Tactic: 9961471 time 0.661504 [06/13/2021-16:49:24] [V] [TRT] Tactic: 10027007 time 0.857088 [06/13/2021-16:49:24] [V] [TRT] Tactic: 10092543 time 0.90112 [06/13/2021-16:49:24] [V] [TRT] Tactic: 10289151 time 0.613376 [06/13/2021-16:49:24] [V] [TRT] Tactic: 10485759 time 0.86016 [06/13/2021-16:49:24] [V] [TRT] Tactic: 10682367 time 0.683008 [06/13/2021-16:49:24] [V] [TRT] Tactic: 10813439 time 0.525312 [06/13/2021-16:49:24] [V] [TRT] Fastest Tactic: 10813439 Time: 0.525312 [06/13/2021-16:49:24] [V] [TRT] --------------- Timing Runner: Conv_318 (CaskConvolution) [06/13/2021-16:49:24] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:24] [V] [TRT] Tactic: 1062367460111450758 time 0.75264 [06/13/2021-16:49:24] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:24] [V] [TRT] Tactic: 1754984623894446479 time 0.736256 [06/13/2021-16:49:24] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:24] [V] [TRT] Tactic: 3611739942397549984 time 0.771872 [06/13/2021-16:49:24] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:24] [V] [TRT] Tactic: 3827454225649558724 time 0.379904 [06/13/2021-16:49:24] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:24] [V] [TRT] Tactic: 4337000649858996379 time 0.65536 [06/13/2021-16:49:24] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:24] [V] [TRT] Tactic: 4501471010995462441 time 0.761856 [06/13/2021-16:49:24] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:24] [V] [TRT] Tactic: 5137655947464784826 time 0.598016 [06/13/2021-16:49:24] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:24] [V] [TRT] Tactic: 5288347012147084929 time 0.743424 [06/13/2021-16:49:24] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:24] [V] [TRT] Tactic: 5921334924264294896 time 0.39424 [06/13/2021-16:49:24] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Tactic: 6645123197870846056 time 0.646144 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7144526460361122478 time 0.64576 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7852627285308570038 time 0.364544 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Tactic: -9137461792520977713 time 0.776192 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:25] [V] [TRT] Tactic: -8776506421218919509 time 0.359424 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Tactic: -8262349710178828730 time 0.768 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Tactic: -8133971918129952780 time 0.73088 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Tactic: -6092040395344634144 time 0.776192 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Tactic: -4787320710726427159 time 0.73216 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Tactic: -3456450830548107839 time 0.644096 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:25] [V] [TRT] Tactic: -2318106587342035239 time 0.362496 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:25] [V] [TRT] Tactic: -1343271414618805657 time 0.355328 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Tactic: -1218658103698133241 time 0.730112 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Tactic: -836875257600482091 time 0.677888 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Tactic: -410470605513481746 time 0.734208 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: -1343271414618805657 Time: 0.355328 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: Conv_318 (CudaConvolution) [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 1.12806 [06/13/2021-16:49:25] [V] [TRT] Tactic: 1 time 1.44179 [06/13/2021-16:49:25] [V] [TRT] Tactic: 2 time 0.951296 [06/13/2021-16:49:25] [V] [TRT] Tactic: 4 skipped. Scratch requested: 4586733568, available: 524288000 [06/13/2021-16:49:25] [V] [TRT] Tactic: 5 skipped. Scratch requested: 2288386048, available: 524288000 [06/13/2021-16:49:25] [V] [TRT] Tactic: 6 time 0.68096 [06/13/2021-16:49:25] [V] [TRT] Tactic: 56 time 1.14483 [06/13/2021-16:49:25] [V] [TRT] Tactic: 57 time 1.49197 [06/13/2021-16:49:25] [V] [TRT] Tactic: 58 time 0.96256 [06/13/2021-16:49:25] [V] [TRT] Tactic: 60 skipped. Scratch requested: 4586733568, available: 524288000 [06/13/2021-16:49:25] [V] [TRT] Tactic: 61 skipped. Scratch requested: 2288386048, available: 524288000 [06/13/2021-16:49:25] [V] [TRT] Tactic: 62 time 0.681984 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 6 Time: 0.68096 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: Conv_318 (CudaDepthwiseConvolution) [06/13/2021-16:49:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: Conv_318 (CublasConvolution) [06/13/2021-16:49:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1343271414618805657 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:25] [V] [TRT] [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: Conv_318 (FusedConvActConvolution) [06/13/2021-16:49:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: Conv_318 (CaskConvolution) [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:25] [V] [TRT] Tactic: -9153228964338181824 time 0.467968 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:25] [V] [TRT] Tactic: -7394439838318485025 time 0.566048 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.467968 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: Conv_318 (CudaConvolution) [06/13/2021-16:49:25] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: Conv_318 (CudaDepthwiseConvolution) [06/13/2021-16:49:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: Conv_318 (CublasConvolution) [06/13/2021-16:49:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:25] [V] [TRT] [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_318 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: LeakyRelu_319 (PointWise) [06/13/2021-16:49:25] [V] [TRT] Tactic: 128 time 0.019456 [06/13/2021-16:49:25] [V] [TRT] Tactic: 256 time 0.019456 [06/13/2021-16:49:25] [V] [TRT] Tactic: 512 time 0.02048 [06/13/2021-16:49:25] [V] [TRT] Tactic: -32 time 0.031744 [06/13/2021-16:49:25] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:25] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 128 Time: 0.019456 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: LeakyRelu_319 (PointWiseV2) [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:25] [V] [TRT] Tactic: 1 time 0.009216 [06/13/2021-16:49:25] [V] [TRT] Tactic: 2 time 0.008192 [06/13/2021-16:49:25] [V] [TRT] Tactic: 3 time 0.009216 [06/13/2021-16:49:25] [V] [TRT] Tactic: 4 time 0.007168 [06/13/2021-16:49:25] [V] [TRT] Tactic: 5 time 0.007168 [06/13/2021-16:49:25] [V] [TRT] Tactic: 6 time 0.009216 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7 time 0.008192 [06/13/2021-16:49:25] [V] [TRT] Tactic: 8 time 0.007168 [06/13/2021-16:49:25] [V] [TRT] Tactic: 9 time 0.007168 [06/13/2021-16:49:25] [V] [TRT] Tactic: 28 time 0.01024 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 4 Time: 0.007168 [06/13/2021-16:49:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [06/13/2021-16:49:25] [V] [TRT] [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: LeakyRelu_319 (PointWise) [06/13/2021-16:49:25] [V] [TRT] Tactic: 128 time 0.02048 [06/13/2021-16:49:25] [V] [TRT] Tactic: 256 time 0.02048 [06/13/2021-16:49:25] [V] [TRT] Tactic: 512 time 0.02048 [06/13/2021-16:49:25] [V] [TRT] Tactic: -32 time 0.03072 [06/13/2021-16:49:25] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:25] [V] [TRT] Tactic: -128 time 0.022528 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 128 Time: 0.02048 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: LeakyRelu_319 (PointWiseV2) [06/13/2021-16:49:25] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:25] [V] [TRT] [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,8192) -> Float(1,16,256:32,8192) *************** [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: LeakyRelu_319 (PointWise) [06/13/2021-16:49:25] [V] [TRT] Tactic: 128 time 0.02048 [06/13/2021-16:49:25] [V] [TRT] Tactic: 256 time 0.02048 [06/13/2021-16:49:25] [V] [TRT] Tactic: 512 time 0.02048 [06/13/2021-16:49:25] [V] [TRT] Tactic: -32 time 0.031744 [06/13/2021-16:49:25] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:25] [V] [TRT] Tactic: -128 time 0.022528 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 128 Time: 0.02048 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: LeakyRelu_319 (PointWiseV2) [06/13/2021-16:49:25] [V] [TRT] Tactic: 24 time 0.011264 [06/13/2021-16:49:25] [V] [TRT] Tactic: 25 time 0.013312 [06/13/2021-16:49:25] [V] [TRT] Tactic: 26 time 0.012288 [06/13/2021-16:49:25] [V] [TRT] Tactic: 27 time 0.011264 [06/13/2021-16:49:25] [V] [TRT] Tactic: 31 time 0.011264 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 24 Time: 0.011264 [06/13/2021-16:49:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:25] [V] [TRT] [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,524288) *************** [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: MaxPool_322 (Pooling) [06/13/2021-16:49:25] [V] [TRT] Tactic: -1 time 0.03584 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: -1 Time: 0.03584 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: MaxPool_322 (TiledPooling) [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733505 time 0.29184 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733506 time 0.147456 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733508 time 0.14848 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733511 time 0.111616 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733512 time 0.075776 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733519 time 0.0768 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733520 time 0.050176 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733761 time 0.14848 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733762 time 0.14848 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733764 time 0.075776 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733767 time 0.058368 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733768 time 0.039936 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733775 time 0.050176 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7733776 time 0.026624 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734017 time 0.22016 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734018 time 0.11264 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734020 time 0.058368 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734023 time 0.045056 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734024 time 0.031744 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734031 time 0.0512 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734032 time 0.027648 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734273 time 0.14848 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734274 time 0.075776 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734276 time 0.039936 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734279 time 0.031744 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734280 time 0.022528 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734287 time 0.03584 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734288 time 0.019456 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734529 time 0.14848 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734530 time 0.075776 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734532 time 0.039936 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734535 time 0.044032 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734536 time 0.03072 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734543 time 0.049088 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734544 time 0.026624 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734785 time 0.111616 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734786 time 0.058368 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734788 time 0.03072 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734791 time 0.034816 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734792 time 0.024576 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734799 time 0.037888 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7734800 time 0.02048 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735041 time 0.11264 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735042 time 0.058368 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735044 time 0.031744 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735047 time 0.034816 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735048 time 0.027648 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735055 time 0.04096 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735056 time 0.022528 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735297 time 0.075776 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735298 time 0.039936 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735300 time 0.022496 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735303 time 0.027648 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735304 time 0.019456 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735311 time 0.03072 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735312 time 0.017408 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735553 time 0.0768 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735554 time 0.040928 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735556 time 0.03072 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735559 time 0.027648 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735560 time 0.022464 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735567 time 0.032768 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735568 time 0.02048 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735809 time 0.0768 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735810 time 0.041824 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735812 time 0.03072 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735815 time 0.03072 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735816 time 0.026624 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735823 time 0.035744 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7735824 time 0.019456 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736065 time 0.0768 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736066 time 0.04096 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736068 time 0.03072 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736071 time 0.037856 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736072 time 0.026624 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736079 time 0.037824 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736080 time 0.022528 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736321 time 0.0768 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736322 time 0.04096 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736324 time 0.031712 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736327 time 0.037856 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736328 time 0.026592 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736335 time 0.039936 [06/13/2021-16:49:25] [V] [TRT] Tactic: 7736336 time 0.022432 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 7735312 Time: 0.017408 [06/13/2021-16:49:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 7735312 [06/13/2021-16:49:25] [V] [TRT] [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:25] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,524288) *************** [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: MaxPool_323 (Pooling) [06/13/2021-16:49:25] [V] [TRT] Tactic: -1 time 0.0768 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: -1 Time: 0.0768 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: MaxPool_323 (TiledPooling) [06/13/2021-16:49:25] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [06/13/2021-16:49:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [06/13/2021-16:49:25] [V] [TRT] [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,524288) *************** [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: MaxPool_324 (Pooling) [06/13/2021-16:49:25] [V] [TRT] Tactic: -1 time 0.128 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: -1 Time: 0.128 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: MaxPool_324 (TiledPooling) [06/13/2021-16:49:25] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [06/13/2021-16:49:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Pooling Tactic: -1 [06/13/2021-16:49:25] [V] [TRT] [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: 1045 copy (Reformat) [06/13/2021-16:49:25] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: 1045 copy (Reformat) [06/13/2021-16:49:25] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: 1045 copy (Reformat) [06/13/2021-16:49:25] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: 1045 copy (Reformat) [06/13/2021-16:49:25] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: 1045 copy (Reformat) [06/13/2021-16:49:25] [V] [TRT] Tactic: 1002 time 0.018432 [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: 1045 copy (Reformat) [06/13/2021-16:49:25] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:25] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 0.037888 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.028672 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:25] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:25] [V] [TRT] Tactic: 0 time 0.03072 [06/13/2021-16:49:25] [V] [TRT] Fastest Tactic: 1002 Time: 0.028672 [06/13/2021-16:49:25] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,524288) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:25] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:25] [V] [TRT] --------------- Timing Runner: Conv_326 (FusedConvActConvolution) [06/13/2021-16:49:25] [V] [TRT] Tactic: 589823 time 0.657408 [06/13/2021-16:49:25] [V] [TRT] Tactic: 655359 time 0.393216 [06/13/2021-16:49:25] [V] [TRT] Tactic: 786431 time 0.349184 [06/13/2021-16:49:25] [V] [TRT] Tactic: 851967 time 0.321536 [06/13/2021-16:49:25] [V] [TRT] Tactic: 1179647 time 0.18944 [06/13/2021-16:49:25] [V] [TRT] Tactic: 1310719 time 0.579584 [06/13/2021-16:49:25] [V] [TRT] Tactic: 1376255 time 0.401408 [06/13/2021-16:49:25] [V] [TRT] Tactic: 1441791 time 0.420864 [06/13/2021-16:49:25] [V] [TRT] Tactic: 1507327 time 0.405504 [06/13/2021-16:49:25] [V] [TRT] Tactic: 1638399 time 0.396288 [06/13/2021-16:49:25] [V] [TRT] Tactic: 1835007 time 0.323584 [06/13/2021-16:49:25] [V] [TRT] Tactic: 1900543 time 0.405504 [06/13/2021-16:49:25] [V] [TRT] Tactic: 2097151 time 0.31232 [06/13/2021-16:49:25] [V] [TRT] Tactic: 2162687 time 0.407552 [06/13/2021-16:49:25] [V] [TRT] Tactic: 2293759 time 0.396288 [06/13/2021-16:49:25] [V] [TRT] Tactic: 2359295 time 0.242592 [06/13/2021-16:49:25] [V] [TRT] Tactic: 2686975 time 0.395264 [06/13/2021-16:49:25] [V] [TRT] Tactic: 3080191 time 0.390144 [06/13/2021-16:49:25] [V] [TRT] Tactic: 3342335 time 0.406528 [06/13/2021-16:49:25] [V] [TRT] Tactic: 3407871 time 0.222208 [06/13/2021-16:49:25] [V] [TRT] Tactic: 3538943 time 0.22528 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3670015 time 0.787456 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3932159 time 0.360448 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3997695 time 0.336896 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4063231 time 0.315392 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4194303 time 0.333824 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4259839 time 0.238592 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4325375 time 0.304128 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4521983 time 0.402432 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4587519 time 0.275456 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4653055 time 0.251904 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4915199 time 0.30208 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4980735 time 0.29696 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5177343 time 0.191488 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5242879 time 0.2304 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5373951 time 0.196608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5439487 time 0.357376 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5570559 time 0.401408 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5636095 time 0.314368 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5701631 time 0.377856 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5767167 time 0.611328 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5832703 time 0.211968 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5898239 time 0.251904 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6029311 time 0.379904 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6225919 time 0.231424 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6291455 time 0.188416 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6422527 time 0.377856 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6750207 time 0.282624 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6815743 time 0.238592 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6946815 time 0.315392 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7012351 time 0.313344 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7077887 time 0.221184 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7143423 time 0.484352 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7208959 time 0.214016 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7340031 time 0.252928 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7405567 time 0.321536 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7536639 time 0.380928 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7602175 time 0.311296 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7733247 time 0.227328 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7798783 time 0.350208 [06/13/2021-16:49:26] [V] [TRT] Tactic: 8191999 time 0.432128 [06/13/2021-16:49:26] [V] [TRT] Tactic: 8257535 time 0.285696 [06/13/2021-16:49:26] [V] [TRT] Tactic: 8323071 time 0.32768 [06/13/2021-16:49:26] [V] [TRT] Tactic: 8650751 time 0.316416 [06/13/2021-16:49:26] [V] [TRT] Tactic: 8716287 time 0.251712 [06/13/2021-16:49:26] [V] [TRT] Tactic: 9109503 time 0.311296 [06/13/2021-16:49:26] [V] [TRT] Tactic: 9568255 time 0.28672 [06/13/2021-16:49:26] [V] [TRT] Tactic: 9895935 time 0.333824 [06/13/2021-16:49:26] [V] [TRT] Tactic: 10223615 time 0.39424 [06/13/2021-16:49:26] [V] [TRT] Tactic: 10354687 time 0.224256 [06/13/2021-16:49:26] [V] [TRT] Tactic: 10551295 time 0.292864 [06/13/2021-16:49:26] [V] [TRT] Tactic: 10747903 time 0.22528 [06/13/2021-16:49:26] [V] [TRT] Tactic: 10944511 time 0.29696 [06/13/2021-16:49:26] [V] [TRT] Fastest Tactic: 6291455 Time: 0.188416 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_326 (CaskConvolution) [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1062367460111450758 time 0.247808 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1698681053543049347 time 0.21504 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4501471010995462441 time 0.196608 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5137655947464784826 time 0.182272 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5288347012147084929 time 0.201728 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5326823351883942011 time 0.18944 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5500448035057547314 time 0.252928 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6645123197870846056 time 0.190464 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7144526460361122478 time 0.222208 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: -8262349710178828730 time 0.203776 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -6576203419454146580 time 0.202752 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: -4787320710726427159 time 0.236544 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -3456450830548107839 time 0.217088 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: -1218658103698133241 time 0.267264 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: -836875257600482091 time 0.257024 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -410470605513481746 time 0.191488 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: -377491875521947884 time 0.19968 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -37215280111360163 time 0.177152 [06/13/2021-16:49:26] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.177152 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_326 (CudaConvolution) [06/13/2021-16:49:26] [V] [TRT] Tactic: 0 time 0.26688 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1 time 0.208896 [06/13/2021-16:49:26] [V] [TRT] Tactic: 2 time 0.29696 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2424832000, available: 524288000 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5 time 2.3808 [06/13/2021-16:49:26] [V] [TRT] Tactic: 56 time 0.26688 [06/13/2021-16:49:26] [V] [TRT] Tactic: 57 time 0.20864 [06/13/2021-16:49:26] [V] [TRT] Tactic: 58 time 0.29696 [06/13/2021-16:49:26] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2424832000, available: 524288000 [06/13/2021-16:49:26] [V] [TRT] Tactic: 61 time 2.32653 [06/13/2021-16:49:26] [V] [TRT] Fastest Tactic: 57 Time: 0.20864 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_326 (CudaDepthwiseConvolution) [06/13/2021-16:49:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_326 (CublasConvolution) [06/13/2021-16:49:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(2048,32768,1,524288) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_326 (FusedConvActConvolution) [06/13/2021-16:49:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_326 (CaskConvolution) [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3886731678879822788 time 0.160768 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6629944304117643200 time 0.135168 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -9153228964338181824 time 0.135168 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -7394439838318485025 time 0.160768 [06/13/2021-16:49:26] [V] [TRT] Fastest Tactic: 6629944304117643200 Time: 0.135168 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_326 (CudaConvolution) [06/13/2021-16:49:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_326 (CudaDepthwiseConvolution) [06/13/2021-16:49:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_326 (CublasConvolution) [06/13/2021-16:49:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6629944304117643200 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,8192) -> Float(1,16,256:32,8192) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,65536) *************** [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_332 (FusedConvActConvolution) [06/13/2021-16:49:26] [V] [TRT] Tactic: 589823 time 0.123552 [06/13/2021-16:49:26] [V] [TRT] Tactic: 655359 time 0.073728 [06/13/2021-16:49:26] [V] [TRT] Tactic: 786431 time 0.0512 [06/13/2021-16:49:26] [V] [TRT] Tactic: 851967 time 0.044032 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1179647 time 0.031744 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1310719 time 0.119808 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1376255 time 0.074752 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1441791 time 0.052224 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1507327 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1638399 time 0.045056 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1835007 time 0.043008 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1900543 time 0.075776 [06/13/2021-16:49:26] [V] [TRT] Tactic: 2097151 time 0.050112 [06/13/2021-16:49:26] [V] [TRT] Tactic: 2162687 time 0.080896 [06/13/2021-16:49:26] [V] [TRT] Tactic: 2293759 time 0.074752 [06/13/2021-16:49:26] [V] [TRT] Tactic: 2359295 time 0.049152 [06/13/2021-16:49:26] [V] [TRT] Tactic: 2686975 time 0.073728 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3080191 time 0.047104 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3342335 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3407871 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3538943 time 0.031744 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3670015 time 0.139264 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3932159 time 0.067584 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3997695 time 0.052224 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4063231 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4194303 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4259839 time 0.039936 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4325375 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4521983 time 0.077824 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4587519 time 0.047104 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4653055 time 0.03584 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4915199 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4980735 time 0.05632 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5177343 time 0.032768 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5242879 time 0.047104 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5373951 time 0.033792 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5439487 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5570559 time 0.045056 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5636095 time 0.047104 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5701631 time 0.073728 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5767167 time 0.070656 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5832703 time 0.044032 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5898239 time 0.04096 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6029311 time 0.068608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6225919 time 0.036864 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6291455 time 0.031744 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6422527 time 0.044032 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6750207 time 0.047104 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6815743 time 0.048128 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6946815 time 0.043008 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7012351 time 0.0512 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7077887 time 0.031744 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7143423 time 0.067584 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7208959 time 0.044032 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7340031 time 0.04096 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7405567 time 0.043008 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7536639 time 0.06656 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7602175 time 0.041984 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7733247 time 0.036864 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7798783 time 0.0512 [06/13/2021-16:49:26] [V] [TRT] Tactic: 8191999 time 0.049152 [06/13/2021-16:49:26] [V] [TRT] Tactic: 8257535 time 0.049152 [06/13/2021-16:49:26] [V] [TRT] Tactic: 8323071 time 0.045056 [06/13/2021-16:49:26] [V] [TRT] Tactic: 8650751 time 0.041984 [06/13/2021-16:49:26] [V] [TRT] Tactic: 8716287 time 0.037888 [06/13/2021-16:49:26] [V] [TRT] Tactic: 9109503 time 0.048128 [06/13/2021-16:49:26] [V] [TRT] Tactic: 9568255 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 9895935 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 10223615 time 0.073728 [06/13/2021-16:49:26] [V] [TRT] Tactic: 10354687 time 0.037888 [06/13/2021-16:49:26] [V] [TRT] Tactic: 10551295 time 0.054272 [06/13/2021-16:49:26] [V] [TRT] Tactic: 10747903 time 0.036864 [06/13/2021-16:49:26] [V] [TRT] Tactic: 10944511 time 0.057344 [06/13/2021-16:49:26] [V] [TRT] Fastest Tactic: 1179647 Time: 0.031744 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_332 (CaskConvolution) [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1062367460111450758 time 0.049152 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1698681053543049347 time 0.047104 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4501471010995462441 time 0.0512 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5137655947464784826 time 0.03584 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5288347012147084929 time 0.050176 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5326823351883942011 time 0.050176 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5500448035057547314 time 0.049152 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6645123197870846056 time 0.038912 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: 7144526460361122478 time 0.049152 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: -8262349710178828730 time 0.0512 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -6576203419454146580 time 0.039936 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: -4787320710726427159 time 0.047104 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -3456450830548107839 time 0.043008 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: -1218658103698133241 time 0.053248 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: -836875257600482091 time 0.0512 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -410470605513481746 time 0.049152 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:26] [V] [TRT] Tactic: -377491875521947884 time 0.049152 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -37215280111360163 time 0.03584 [06/13/2021-16:49:26] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.03584 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_332 (CudaConvolution) [06/13/2021-16:49:26] [V] [TRT] Tactic: 0 time 0.057344 [06/13/2021-16:49:26] [V] [TRT] Tactic: 1 time 0.04608 [06/13/2021-16:49:26] [V] [TRT] Tactic: 2 time 0.110592 [06/13/2021-16:49:26] [V] [TRT] Tactic: 4 time 1.6425 [06/13/2021-16:49:26] [V] [TRT] Tactic: 5 time 0.35008 [06/13/2021-16:49:26] [V] [TRT] Tactic: 56 time 0.057344 [06/13/2021-16:49:26] [V] [TRT] Tactic: 57 time 0.045056 [06/13/2021-16:49:26] [V] [TRT] Tactic: 58 time 0.110592 [06/13/2021-16:49:26] [V] [TRT] Tactic: 60 time 1.6599 [06/13/2021-16:49:26] [V] [TRT] Tactic: 61 time 0.35728 [06/13/2021-16:49:26] [V] [TRT] Fastest Tactic: 57 Time: 0.045056 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_332 (CudaDepthwiseConvolution) [06/13/2021-16:49:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_332 (CublasConvolution) [06/13/2021-16:49:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 1179647 [06/13/2021-16:49:26] [V] [TRT] [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(256,4096,1,65536) *************** [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_332 (FusedConvActConvolution) [06/13/2021-16:49:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_332 (CaskConvolution) [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 3886731678879822788 time 0.027648 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: 6629944304117643200 time 0.027648 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -9153228964338181824 time 0.027648 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Tactic: -7394439838318485025 time 0.028672 [06/13/2021-16:49:26] [V] [TRT] Fastest Tactic: 3886731678879822788 Time: 0.027648 [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_332 (CudaConvolution) [06/13/2021-16:49:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_332 (CudaDepthwiseConvolution) [06/13/2021-16:49:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] --------------- Timing Runner: Conv_332 (CublasConvolution) [06/13/2021-16:49:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] Conv_332 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:28] [V] [TRT] --------------- Timing Runner: LeakyRelu_402 (PointWise) [06/13/2021-16:49:28] [V] [TRT] Tactic: 128 time 0.024576 [06/13/2021-16:49:28] [V] [TRT] Tactic: 256 time 0.024576 [06/13/2021-16:49:28] [V] [TRT] Tactic: 512 time 0.024576 [06/13/2021-16:49:28] [V] [TRT] Tactic: -32 time 0.032768 [06/13/2021-16:49:28] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:28] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:28] [V] [TRT] Fastest Tactic: -64 Time: 0.023552 [06/13/2021-16:49:28] [V] [TRT] --------------- Timing Runner: LeakyRelu_402 (PointWiseV2) [06/13/2021-16:49:28] [V] [TRT] Tactic: 0 time 0.013312 [06/13/2021-16:49:28] [V] [TRT] Tactic: 1 time 0.01024 [06/13/2021-16:49:28] [V] [TRT] Tactic: 2 time 0.009216 [06/13/2021-16:49:28] [V] [TRT] Tactic: 3 time 0.009216 [06/13/2021-16:49:28] [V] [TRT] Tactic: 4 time 0.008192 [06/13/2021-16:49:28] [V] [TRT] Tactic: 5 time 0.007392 [06/13/2021-16:49:28] [V] [TRT] Tactic: 6 time 0.009216 [06/13/2021-16:49:28] [V] [TRT] Tactic: 7 time 0.007392 [06/13/2021-16:49:28] [V] [TRT] Tactic: 8 time 0.007168 [06/13/2021-16:49:28] [V] [TRT] Tactic: 9 time 0.006144 [06/13/2021-16:49:28] [V] [TRT] Tactic: 28 time 0.013312 [06/13/2021-16:49:28] [V] [TRT] Fastest Tactic: 9 Time: 0.006144 [06/13/2021-16:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [06/13/2021-16:49:28] [V] [TRT] [06/13/2021-16:49:28] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:28] [V] [TRT] --------------- Timing Runner: LeakyRelu_402 (PointWise) [06/13/2021-16:49:28] [V] [TRT] Tactic: 128 time 0.024576 [06/13/2021-16:49:28] [V] [TRT] Tactic: 256 time 0.024512 [06/13/2021-16:49:28] [V] [TRT] Tactic: 512 time 0.024576 [06/13/2021-16:49:28] [V] [TRT] Tactic: -32 time 0.0256 [06/13/2021-16:49:28] [V] [TRT] Tactic: -64 time 0.022528 [06/13/2021-16:49:28] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:28] [V] [TRT] Fastest Tactic: -64 Time: 0.022528 [06/13/2021-16:49:28] [V] [TRT] --------------- Timing Runner: LeakyRelu_402 (PointWiseV2) [06/13/2021-16:49:28] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: -64 [06/13/2021-16:49:28] [V] [TRT] [06/13/2021-16:49:28] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_402 (PointWise) [06/13/2021-16:49:29] [V] [TRT] Tactic: 128 time 0.024576 [06/13/2021-16:49:29] [V] [TRT] Tactic: 256 time 0.024576 [06/13/2021-16:49:29] [V] [TRT] Tactic: 512 time 0.024576 [06/13/2021-16:49:29] [V] [TRT] Tactic: -32 time 0.031744 [06/13/2021-16:49:29] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:29] [V] [TRT] Tactic: -128 time 0.023552 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: -64 Time: 0.023552 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_402 (PointWiseV2) [06/13/2021-16:49:29] [V] [TRT] Tactic: 24 time 0.011296 [06/13/2021-16:49:29] [V] [TRT] Tactic: 25 time 0.013312 [06/13/2021-16:49:29] [V] [TRT] Tactic: 26 time 0.012288 [06/13/2021-16:49:29] [V] [TRT] Tactic: 27 time 0.011264 [06/13/2021-16:49:29] [V] [TRT] Tactic: 31 time 0.011264 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 27 Time: 0.011264 [06/13/2021-16:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [06/13/2021-16:49:29] [V] [TRT] [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.009216 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.012288 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.007168 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.007168 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,16,256,65536) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_333 (PointWise) [06/13/2021-16:49:29] [V] [TRT] Tactic: 128 time 0.007168 [06/13/2021-16:49:29] [V] [TRT] Tactic: 256 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: 512 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: -32 time 0.024576 [06/13/2021-16:49:29] [V] [TRT] Tactic: -64 time 0.01536 [06/13/2021-16:49:29] [V] [TRT] Tactic: -128 time 0.01024 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 128 Time: 0.007168 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_333 (PointWiseV2) [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1 time 0.00512 [06/13/2021-16:49:29] [V] [TRT] Tactic: 2 time 0.00512 [06/13/2021-16:49:29] [V] [TRT] Tactic: 3 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 4 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 5 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 6 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 7 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 8 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 9 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 28 time 0.00512 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 3 Time: 0.004096 [06/13/2021-16:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [06/13/2021-16:49:29] [V] [TRT] [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(256,4096,1,65536) -> Float(256,4096,1,65536) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_333 (PointWise) [06/13/2021-16:49:29] [V] [TRT] Tactic: 128 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: 256 time 0.007168 [06/13/2021-16:49:29] [V] [TRT] Tactic: 512 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: -32 time 0.024576 [06/13/2021-16:49:29] [V] [TRT] Tactic: -64 time 0.01536 [06/13/2021-16:49:29] [V] [TRT] Tactic: -128 time 0.01024 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 256 Time: 0.007168 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_333 (PointWiseV2) [06/13/2021-16:49:29] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 256 [06/13/2021-16:49:29] [V] [TRT] [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,2048) -> Float(1,16,256:32,2048) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_333 (PointWise) [06/13/2021-16:49:29] [V] [TRT] Tactic: 128 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: 256 time 0.007168 [06/13/2021-16:49:29] [V] [TRT] Tactic: 512 time 0.007168 [06/13/2021-16:49:29] [V] [TRT] Tactic: -32 time 0.024576 [06/13/2021-16:49:29] [V] [TRT] Tactic: -64 time 0.01536 [06/13/2021-16:49:29] [V] [TRT] Tactic: -128 time 0.01024 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 256 Time: 0.007168 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_333 (PointWiseV2) [06/13/2021-16:49:29] [V] [TRT] Tactic: 24 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 25 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 26 time 0.00512 [06/13/2021-16:49:29] [V] [TRT] Tactic: 27 time 0.006144 [06/13/2021-16:49:29] [V] [TRT] Tactic: 31 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 24 Time: 0.004096 [06/13/2021-16:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:29] [V] [TRT] [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,65536) -> Float(1,1,16,16,256,65536) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: Reshape_351 (Shuffle) [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1 time 0.045216 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(256,4096,1,65536) -> Float(1,1,1,16,256,65536) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: Reshape_351 (Shuffle) [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1 time 0.137216 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,2048) -> Float(1,1,16:32,16,256,65536) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: Reshape_351 (Shuffle) [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.187392 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1 time 0.553984 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.187392 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.04096 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.091136 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.01536 [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,1,16,16,256,65536) -> Float(1,2,32,64,1024,262144) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: Expand_378 (Slice) [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.116736 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.01536 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.224256 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.33792 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.224256 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.115712 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.016384 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.224256 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.33792 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.224256 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.124928 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.01536 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.165888 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.33792 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.165888 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.144384 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.029696 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.029696 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:29] [V] [TRT] Tactic: 1002 time 0.161792 [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.028672 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.028672 [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,2,32,64,1024,262144) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: Reshape_400 (Shuffle) [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1 time 0.03072 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(2,4,1,64,1024,262144) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: Reshape_400 (Shuffle) [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.027648 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1 time 0.13824 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.027648 [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,2,32:32,32,512,131072) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: Reshape_400 (Shuffle) [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.032768 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1 time 0.190464 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 0 Time: 0.032768 [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_405 (PointWise) [06/13/2021-16:49:29] [V] [TRT] Tactic: 128 time 0.019456 [06/13/2021-16:49:29] [V] [TRT] Tactic: 256 time 0.019456 [06/13/2021-16:49:29] [V] [TRT] Tactic: 512 time 0.02048 [06/13/2021-16:49:29] [V] [TRT] Tactic: -32 time 0.031744 [06/13/2021-16:49:29] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:29] [V] [TRT] Tactic: -128 time 0.022528 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 128 Time: 0.019456 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_405 (PointWiseV2) [06/13/2021-16:49:29] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1 time 0.009216 [06/13/2021-16:49:29] [V] [TRT] Tactic: 2 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: 3 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: 4 time 0.007168 [06/13/2021-16:49:29] [V] [TRT] Tactic: 5 time 0.007168 [06/13/2021-16:49:29] [V] [TRT] Tactic: 6 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: 7 time 0.008192 [06/13/2021-16:49:29] [V] [TRT] Tactic: 8 time 0.007168 [06/13/2021-16:49:29] [V] [TRT] Tactic: 9 time 0.007168 [06/13/2021-16:49:29] [V] [TRT] Tactic: 28 time 0.011264 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 4 Time: 0.007168 [06/13/2021-16:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [06/13/2021-16:49:29] [V] [TRT] [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_405 (PointWise) [06/13/2021-16:49:29] [V] [TRT] Tactic: 128 time 0.019456 [06/13/2021-16:49:29] [V] [TRT] Tactic: 256 time 0.019456 [06/13/2021-16:49:29] [V] [TRT] Tactic: 512 time 0.02048 [06/13/2021-16:49:29] [V] [TRT] Tactic: -32 time 0.03072 [06/13/2021-16:49:29] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:29] [V] [TRT] Tactic: -128 time 0.022528 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 128 Time: 0.019456 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_405 (PointWiseV2) [06/13/2021-16:49:29] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:29] [V] [TRT] [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_405 (PointWise) [06/13/2021-16:49:29] [V] [TRT] Tactic: 128 time 0.02048 [06/13/2021-16:49:29] [V] [TRT] Tactic: 256 time 0.019456 [06/13/2021-16:49:29] [V] [TRT] Tactic: 512 time 0.02048 [06/13/2021-16:49:29] [V] [TRT] Tactic: -32 time 0.03072 [06/13/2021-16:49:29] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:29] [V] [TRT] Tactic: -128 time 0.022528 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 256 Time: 0.019456 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_405 (PointWiseV2) [06/13/2021-16:49:29] [V] [TRT] Tactic: 24 time 0.012288 [06/13/2021-16:49:29] [V] [TRT] Tactic: 25 time 0.013312 [06/13/2021-16:49:29] [V] [TRT] Tactic: 26 time 0.012288 [06/13/2021-16:49:29] [V] [TRT] Tactic: 27 time 0.011264 [06/13/2021-16:49:29] [V] [TRT] Tactic: 31 time 0.011264 [06/13/2021-16:49:29] [V] [TRT] Fastest Tactic: 27 Time: 0.011264 [06/13/2021-16:49:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [06/13/2021-16:49:29] [V] [TRT] [06/13/2021-16:49:29] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:29] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:29] [V] [TRT] --------------- Timing Runner: Conv_406 (FusedConvActConvolution) [06/13/2021-16:49:29] [V] [TRT] Tactic: 524287 time 0.59392 [06/13/2021-16:49:29] [V] [TRT] Tactic: 720895 time 0.602112 [06/13/2021-16:49:29] [V] [TRT] Tactic: 983039 time 0.548864 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1048575 time 0.59392 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1703935 time 0.6144 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1769471 time 0.692224 [06/13/2021-16:49:29] [V] [TRT] Tactic: 1966079 time 0.557056 [06/13/2021-16:49:29] [V] [TRT] Tactic: 2031615 time 0.571392 [06/13/2021-16:49:29] [V] [TRT] Tactic: 2228223 time 0.607232 [06/13/2021-16:49:29] [V] [TRT] Tactic: 2424831 time 0.874496 [06/13/2021-16:49:29] [V] [TRT] Tactic: 2621439 time 0.61952 [06/13/2021-16:49:29] [V] [TRT] Tactic: 2752511 time 0.581632 [06/13/2021-16:49:29] [V] [TRT] Tactic: 2818047 time 0.840704 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2883583 time 0.589824 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3014655 time 0.52736 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3145727 time 0.565248 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3473407 time 0.514048 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3604479 time 0.510976 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3735551 time 0.549888 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4390911 time 0.636928 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5046271 time 0.663552 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5963775 time 0.54784 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6160383 time 0.55296 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6488063 time 0.603136 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6881279 time 0.54784 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7274495 time 0.656288 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7864319 time 0.715776 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7995391 time 0.483328 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8585215 time 0.615424 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8847359 time 0.62464 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8978431 time 0.608256 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9043967 time 0.607232 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9175039 time 0.51712 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9502719 time 0.62464 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9830399 time 0.529408 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9961471 time 0.548864 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10027007 time 0.598016 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10092543 time 0.631808 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10289151 time 0.553984 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10485759 time 0.66048 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10682367 time 0.587776 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10813439 time 0.490496 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 7995391 Time: 0.483328 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_406 (CaskConvolution) [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1062367460111450758 time 0.67072 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1754984623894446479 time 0.661504 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3611739942397549984 time 0.600064 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3827454225649558724 time 0.26624 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4337000649858996379 time 0.594176 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4501471010995462441 time 0.598016 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5137655947464784826 time 0.546816 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5288347012147084929 time 0.582656 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5921334924264294896 time 0.265216 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6645123197870846056 time 0.576576 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7144526460361122478 time 0.553984 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7852627285308570038 time 0.26624 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -9137461792520977713 time 0.612352 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -8776506421218919509 time 0.254976 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -8262349710178828730 time 0.596992 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -8133971918129952780 time 0.699392 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -6092040395344634144 time 0.707584 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -4787320710726427159 time 0.657408 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -3456450830548107839 time 0.60928 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -2318106587342035239 time 0.259072 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -1343271414618805657 time 0.27824 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -1218658103698133241 time 0.698368 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -836875257600482091 time 0.653344 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -410470605513481746 time 0.576512 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: -8776506421218919509 Time: 0.254976 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_406 (CudaConvolution) [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 1.1039 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1 time 0.618496 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2 time 0.84992 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4 skipped. Scratch requested: 4442554368, available: 524288000 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 524288000 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6 time 0.370688 [06/13/2021-16:49:30] [V] [TRT] Tactic: 56 time 1.16838 [06/13/2021-16:49:30] [V] [TRT] Tactic: 57 time 0.631808 [06/13/2021-16:49:30] [V] [TRT] Tactic: 58 time 0.851968 [06/13/2021-16:49:30] [V] [TRT] Tactic: 60 skipped. Scratch requested: 4442554368, available: 524288000 [06/13/2021-16:49:30] [V] [TRT] Tactic: 61 skipped. Scratch requested: 577110016, available: 524288000 [06/13/2021-16:49:30] [V] [TRT] Tactic: 62 time 0.361472 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 62 Time: 0.361472 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_406 (CudaDepthwiseConvolution) [06/13/2021-16:49:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_406 (CublasConvolution) [06/13/2021-16:49:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8776506421218919509 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_406 (FusedConvActConvolution) [06/13/2021-16:49:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_406 (CaskConvolution) [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -9153228964338181824 time 0.433152 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -7394439838318485025 time 0.463008 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.433152 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_406 (CudaConvolution) [06/13/2021-16:49:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_406 (CudaDepthwiseConvolution) [06/13/2021-16:49:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_406 (CublasConvolution) [06/13/2021-16:49:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_406 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_407 (PointWise) [06/13/2021-16:49:30] [V] [TRT] Tactic: 128 time 0.03584 [06/13/2021-16:49:30] [V] [TRT] Tactic: 256 time 0.036864 [06/13/2021-16:49:30] [V] [TRT] Tactic: 512 time 0.036864 [06/13/2021-16:49:30] [V] [TRT] Tactic: -32 time 0.059392 [06/13/2021-16:49:30] [V] [TRT] Tactic: -64 time 0.041984 [06/13/2021-16:49:30] [V] [TRT] Tactic: -128 time 0.039936 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 128 Time: 0.03584 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_407 (PointWiseV2) [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2 time 0.023552 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4 time 0.023552 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5 time 0.023552 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8 time 0.022528 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9 time 0.023552 [06/13/2021-16:49:30] [V] [TRT] Tactic: 28 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 8 Time: 0.022528 [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_407 (PointWise) [06/13/2021-16:49:30] [V] [TRT] Tactic: 128 time 0.03584 [06/13/2021-16:49:30] [V] [TRT] Tactic: 256 time 0.035904 [06/13/2021-16:49:30] [V] [TRT] Tactic: 512 time 0.036864 [06/13/2021-16:49:30] [V] [TRT] Tactic: -32 time 0.059392 [06/13/2021-16:49:30] [V] [TRT] Tactic: -64 time 0.041984 [06/13/2021-16:49:30] [V] [TRT] Tactic: -128 time 0.039936 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 128 Time: 0.03584 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_407 (PointWiseV2) [06/13/2021-16:49:30] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,16384) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_407 (PointWise) [06/13/2021-16:49:30] [V] [TRT] Tactic: 128 time 0.036128 [06/13/2021-16:49:30] [V] [TRT] Tactic: 256 time 0.036864 [06/13/2021-16:49:30] [V] [TRT] Tactic: 512 time 0.037024 [06/13/2021-16:49:30] [V] [TRT] Tactic: -32 time 0.059392 [06/13/2021-16:49:30] [V] [TRT] Tactic: -64 time 0.041984 [06/13/2021-16:49:30] [V] [TRT] Tactic: -128 time 0.039936 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 128 Time: 0.036128 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_407 (PointWiseV2) [06/13/2021-16:49:30] [V] [TRT] Tactic: 24 time 0.0256 [06/13/2021-16:49:30] [V] [TRT] Tactic: 25 time 0.026624 [06/13/2021-16:49:30] [V] [TRT] Tactic: 26 time 0.027648 [06/13/2021-16:49:30] [V] [TRT] Tactic: 27 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 31 time 0.0256 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 27 Time: 0.024576 [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,16384) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,131072) *************** [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_414 (FusedConvActConvolution) [06/13/2021-16:49:30] [V] [TRT] Tactic: 589823 time 0.068608 [06/13/2021-16:49:30] [V] [TRT] Tactic: 655359 time 0.04608 [06/13/2021-16:49:30] [V] [TRT] Tactic: 786431 time 0.055296 [06/13/2021-16:49:30] [V] [TRT] Tactic: 851967 time 0.034816 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1179647 time 0.033792 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1310719 time 0.090112 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1376255 time 0.049152 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1441791 time 0.049152 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1507327 time 0.037888 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1638399 time 0.04608 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1835007 time 0.050176 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1900543 time 0.0512 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2097151 time 0.048128 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2162687 time 0.052224 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2293759 time 0.052224 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2359295 time 0.038912 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2686975 time 0.053248 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3080191 time 0.034816 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3342335 time 0.036864 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3407871 time 0.037888 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3538943 time 0.036864 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3670015 time 0.080896 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3932159 time 0.04608 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3997695 time 0.048128 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4063231 time 0.03584 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4194303 time 0.052224 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4259839 time 0.043008 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4325375 time 0.058368 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4521983 time 0.052224 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4587519 time 0.047104 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4653055 time 0.034816 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4915199 time 0.04608 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4980735 time 0.047104 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5177343 time 0.034816 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5242879 time 0.038912 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5373951 time 0.041984 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5439487 time 0.073728 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5570559 time 0.036864 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5636095 time 0.03584 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5701631 time 0.050176 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5767167 time 0.123904 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5832703 time 0.037888 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5898239 time 0.034816 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6029311 time 0.049152 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6225919 time 0.038912 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6291455 time 0.033792 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6422527 time 0.03584 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6750207 time 0.04608 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6815743 time 0.04096 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6946815 time 0.06144 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7012351 time 0.048128 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7077887 time 0.033792 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7143423 time 0.070656 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7208959 time 0.036864 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7340031 time 0.034816 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7405567 time 0.03584 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7536639 time 0.054272 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7602175 time 0.048128 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7733247 time 0.033792 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7798783 time 0.052224 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8191999 time 0.055296 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8257535 time 0.047104 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8323071 time 0.054272 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8650751 time 0.050176 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8716287 time 0.0512 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9109503 time 0.04608 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9568255 time 0.04608 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9895935 time 0.052224 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10223615 time 0.052224 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10354687 time 0.04096 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10551295 time 0.04608 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10747903 time 0.033792 [06/13/2021-16:49:30] [V] [TRT] Tactic: 10944511 time 0.047104 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 1179647 Time: 0.033792 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_414 (CaskConvolution) [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1062367460111450758 time 0.036864 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1698681053543049347 time 0.027648 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4501471010995462441 time 0.029696 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5137655947464784826 time 0.029696 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5288347012147084929 time 0.029696 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5326823351883942011 time 0.029696 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5500448035057547314 time 0.03584 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6645123197870846056 time 0.03072 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7144526460361122478 time 0.029696 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -8262349710178828730 time 0.029696 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -6576203419454146580 time 0.031744 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -4787320710726427159 time 0.03072 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -3456450830548107839 time 0.033792 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -1218658103698133241 time 0.037888 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -836875257600482091 time 0.04608 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -410470605513481746 time 0.038912 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Tactic: -377491875521947884 time 0.028672 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -37215280111360163 time 0.028672 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 1698681053543049347 Time: 0.027648 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_414 (CudaConvolution) [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 0.047104 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1 time 0.038912 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2 time 0.134144 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4 time 1.43872 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5 time 0.135168 [06/13/2021-16:49:30] [V] [TRT] Tactic: 56 time 0.0512 [06/13/2021-16:49:30] [V] [TRT] Tactic: 57 time 0.039936 [06/13/2021-16:49:30] [V] [TRT] Tactic: 58 time 0.13312 [06/13/2021-16:49:30] [V] [TRT] Tactic: 60 time 1.45203 [06/13/2021-16:49:30] [V] [TRT] Tactic: 61 time 0.130048 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 1 Time: 0.038912 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_414 (CudaDepthwiseConvolution) [06/13/2021-16:49:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_414 (CublasConvolution) [06/13/2021-16:49:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(128,4096,1,131072) *************** [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_414 (FusedConvActConvolution) [06/13/2021-16:49:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_414 (CaskConvolution) [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3886731678879822788 time 0.027648 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6629944304117643200 time 0.0256 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -9153228964338181824 time 0.0256 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Tactic: -7394439838318485025 time 0.026624 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 6629944304117643200 Time: 0.0256 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_414 (CudaConvolution) [06/13/2021-16:49:30] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_414 (CudaDepthwiseConvolution) [06/13/2021-16:49:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: Conv_414 (CublasConvolution) [06/13/2021-16:49:30] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6629944304117643200 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_484 (PointWise) [06/13/2021-16:49:30] [V] [TRT] Tactic: 128 time 0.045056 [06/13/2021-16:49:30] [V] [TRT] Tactic: 256 time 0.045056 [06/13/2021-16:49:30] [V] [TRT] Tactic: 512 time 0.045056 [06/13/2021-16:49:30] [V] [TRT] Tactic: -32 time 0.060416 [06/13/2021-16:49:30] [V] [TRT] Tactic: -64 time 0.043008 [06/13/2021-16:49:30] [V] [TRT] Tactic: -128 time 0.04096 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: -128 Time: 0.04096 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_484 (PointWiseV2) [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 0.0256 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1 time 0.023552 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2 time 0.023552 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4 time 0.023552 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8 time 0.023552 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9 time 0.022528 [06/13/2021-16:49:30] [V] [TRT] Tactic: 28 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 9 Time: 0.022528 [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_484 (PointWise) [06/13/2021-16:49:30] [V] [TRT] Tactic: 128 time 0.045088 [06/13/2021-16:49:30] [V] [TRT] Tactic: 256 time 0.045056 [06/13/2021-16:49:30] [V] [TRT] Tactic: 512 time 0.04608 [06/13/2021-16:49:30] [V] [TRT] Tactic: -32 time 0.044032 [06/13/2021-16:49:30] [V] [TRT] Tactic: -64 time 0.044032 [06/13/2021-16:49:30] [V] [TRT] Tactic: -128 time 0.050176 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: -32 Time: 0.044032 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_484 (PointWiseV2) [06/13/2021-16:49:30] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: -32 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,32768) *************** [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_484 (PointWise) [06/13/2021-16:49:30] [V] [TRT] Tactic: 128 time 0.045056 [06/13/2021-16:49:30] [V] [TRT] Tactic: 256 time 0.045056 [06/13/2021-16:49:30] [V] [TRT] Tactic: 512 time 0.045056 [06/13/2021-16:49:30] [V] [TRT] Tactic: -32 time 0.060416 [06/13/2021-16:49:30] [V] [TRT] Tactic: -64 time 0.041984 [06/13/2021-16:49:30] [V] [TRT] Tactic: -128 time 0.04096 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: -128 Time: 0.04096 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_484 (PointWiseV2) [06/13/2021-16:49:30] [V] [TRT] Tactic: 24 time 0.026624 [06/13/2021-16:49:30] [V] [TRT] Tactic: 25 time 0.027648 [06/13/2021-16:49:30] [V] [TRT] Tactic: 26 time 0.027648 [06/13/2021-16:49:30] [V] [TRT] Tactic: 27 time 0.024576 [06/13/2021-16:49:30] [V] [TRT] Tactic: 31 time 0.026624 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 27 Time: 0.024576 [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:30] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:30] [V] [TRT] Tactic: 1002 time 0.012288 [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:30] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:30] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:30] [V] [TRT] Tactic: 1002 time 0.018432 [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:30] [V] [TRT] Tactic: 1002 time 0.013216 [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,131072) -> Float(1,32,1024,131072) *************** [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_415 (PointWise) [06/13/2021-16:49:30] [V] [TRT] Tactic: 128 time 0.011264 [06/13/2021-16:49:30] [V] [TRT] Tactic: 256 time 0.012288 [06/13/2021-16:49:30] [V] [TRT] Tactic: 512 time 0.012288 [06/13/2021-16:49:30] [V] [TRT] Tactic: -32 time 0.0256 [06/13/2021-16:49:30] [V] [TRT] Tactic: -64 time 0.016384 [06/13/2021-16:49:30] [V] [TRT] Tactic: -128 time 0.013312 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 128 Time: 0.011264 [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_415 (PointWiseV2) [06/13/2021-16:49:30] [V] [TRT] Tactic: 0 time 0.007168 [06/13/2021-16:49:30] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:30] [V] [TRT] Tactic: 2 time 0.006144 [06/13/2021-16:49:30] [V] [TRT] Tactic: 3 time 0.00512 [06/13/2021-16:49:30] [V] [TRT] Tactic: 4 time 0.00512 [06/13/2021-16:49:30] [V] [TRT] Tactic: 5 time 0.00512 [06/13/2021-16:49:30] [V] [TRT] Tactic: 6 time 0.00512 [06/13/2021-16:49:30] [V] [TRT] Tactic: 7 time 0.00512 [06/13/2021-16:49:30] [V] [TRT] Tactic: 8 time 0.004096 [06/13/2021-16:49:30] [V] [TRT] Tactic: 9 time 0.00512 [06/13/2021-16:49:30] [V] [TRT] Tactic: 28 time 0.006144 [06/13/2021-16:49:30] [V] [TRT] Fastest Tactic: 8 Time: 0.004096 [06/13/2021-16:49:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [06/13/2021-16:49:30] [V] [TRT] [06/13/2021-16:49:30] [V] [TRT] *************** Autotuning format combination: Float(128,4096,1,131072) -> Float(128,4096,1,131072) *************** [06/13/2021-16:49:30] [V] [TRT] --------------- Timing Runner: LeakyRelu_415 (PointWise) [06/13/2021-16:49:31] [V] [TRT] Tactic: 128 time 0.011264 [06/13/2021-16:49:31] [V] [TRT] Tactic: 256 time 0.012288 [06/13/2021-16:49:31] [V] [TRT] Tactic: 512 time 0.012288 [06/13/2021-16:49:31] [V] [TRT] Tactic: -32 time 0.0256 [06/13/2021-16:49:31] [V] [TRT] Tactic: -64 time 0.016384 [06/13/2021-16:49:31] [V] [TRT] Tactic: -128 time 0.013312 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 128 Time: 0.011264 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_415 (PointWiseV2) [06/13/2021-16:49:31] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,4096) -> Float(1,32,1024:32,4096) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_415 (PointWise) [06/13/2021-16:49:31] [V] [TRT] Tactic: 128 time 0.011264 [06/13/2021-16:49:31] [V] [TRT] Tactic: 256 time 0.011264 [06/13/2021-16:49:31] [V] [TRT] Tactic: 512 time 0.012288 [06/13/2021-16:49:31] [V] [TRT] Tactic: -32 time 0.0256 [06/13/2021-16:49:31] [V] [TRT] Tactic: -64 time 0.016384 [06/13/2021-16:49:31] [V] [TRT] Tactic: -128 time 0.013312 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 128 Time: 0.011264 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_415 (PointWiseV2) [06/13/2021-16:49:31] [V] [TRT] Tactic: 24 time 0.00512 [06/13/2021-16:49:31] [V] [TRT] Tactic: 25 time 0.00512 [06/13/2021-16:49:31] [V] [TRT] Tactic: 26 time 0.00512 [06/13/2021-16:49:31] [V] [TRT] Tactic: 27 time 0.006144 [06/13/2021-16:49:31] [V] [TRT] Tactic: 31 time 0.006144 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 24 Time: 0.00512 [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,131072) -> Float(1,1,32,32,1024,131072) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Reshape_433 (Shuffle) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1 time 0.047104 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(128,4096,1,131072) -> Float(1,1,1,32,1024,131072) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Reshape_433 (Shuffle) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.012288 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1 time 0.15872 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,4096) -> Float(1,1,32:32,32,1024,131072) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Reshape_433 (Shuffle) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.34816 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1 time 0.336896 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 1 Time: 0.336896 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:31] [V] [TRT] Tactic: 1002 time 0.039936 [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:31] [V] [TRT] Tactic: 1002 time 0.091136 [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.026624 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.026624 [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,1,32,32,1024,131072) -> Float(1,2,64,128,4096,524288) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Expand_460 (Slice) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:31] [V] [TRT] Tactic: 1002 time 0.229376 [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.028672 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.028672 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:31] [V] [TRT] Tactic: 1002 time 0.432128 [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.663552 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.432128 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:31] [V] [TRT] Tactic: 1002 time 0.229376 [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.028672 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.028672 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:31] [V] [TRT] Tactic: 1002 time 0.434112 [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.664576 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.434112 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:31] [V] [TRT] Tactic: 1002 time 0.243712 [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.027648 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.027648 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:31] [V] [TRT] Tactic: 1002 time 0.336896 [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.663552 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.336896 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:31] [V] [TRT] Tactic: 1002 time 0.144384 [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.055296 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.055296 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:31] [V] [TRT] Tactic: 1002 time 0.310272 [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.054272 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.054272 [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,2,64,128,4096,524288) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Reshape_482 (Shuffle) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1 time 0.059392 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.024576 [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(2,4,1,128,4096,524288) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Reshape_482 (Shuffle) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.054176 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1 time 0.270336 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.054176 [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,2,64:32,64,2048,262144) -> Float(1,64,4096:32,32768) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Reshape_482 (Shuffle) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.065536 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1 time 0.210944 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 0 Time: 0.065536 [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_487 (PointWise) [06/13/2021-16:49:31] [V] [TRT] Tactic: 128 time 0.036864 [06/13/2021-16:49:31] [V] [TRT] Tactic: 256 time 0.036864 [06/13/2021-16:49:31] [V] [TRT] Tactic: 512 time 0.036864 [06/13/2021-16:49:31] [V] [TRT] Tactic: -32 time 0.059392 [06/13/2021-16:49:31] [V] [TRT] Tactic: -64 time 0.041984 [06/13/2021-16:49:31] [V] [TRT] Tactic: -128 time 0.039936 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 128 Time: 0.036864 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_487 (PointWiseV2) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1 time 0.023552 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2 time 0.022528 [06/13/2021-16:49:31] [V] [TRT] Tactic: 3 time 0.024576 [06/13/2021-16:49:31] [V] [TRT] Tactic: 4 time 0.023552 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5 time 0.022528 [06/13/2021-16:49:31] [V] [TRT] Tactic: 6 time 0.0256 [06/13/2021-16:49:31] [V] [TRT] Tactic: 7 time 0.024576 [06/13/2021-16:49:31] [V] [TRT] Tactic: 8 time 0.023552 [06/13/2021-16:49:31] [V] [TRT] Tactic: 9 time 0.023552 [06/13/2021-16:49:31] [V] [TRT] Tactic: 28 time 0.024576 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 2 Time: 0.022528 [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_487 (PointWise) [06/13/2021-16:49:31] [V] [TRT] Tactic: 128 time 0.036864 [06/13/2021-16:49:31] [V] [TRT] Tactic: 256 time 0.036864 [06/13/2021-16:49:31] [V] [TRT] Tactic: 512 time 0.036864 [06/13/2021-16:49:31] [V] [TRT] Tactic: -32 time 0.060416 [06/13/2021-16:49:31] [V] [TRT] Tactic: -64 time 0.041984 [06/13/2021-16:49:31] [V] [TRT] Tactic: -128 time 0.039936 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 128 Time: 0.036864 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_487 (PointWiseV2) [06/13/2021-16:49:31] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_487 (PointWise) [06/13/2021-16:49:31] [V] [TRT] Tactic: 128 time 0.03584 [06/13/2021-16:49:31] [V] [TRT] Tactic: 256 time 0.036864 [06/13/2021-16:49:31] [V] [TRT] Tactic: 512 time 0.036864 [06/13/2021-16:49:31] [V] [TRT] Tactic: -32 time 0.059392 [06/13/2021-16:49:31] [V] [TRT] Tactic: -64 time 0.041984 [06/13/2021-16:49:31] [V] [TRT] Tactic: -128 time 0.039936 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 128 Time: 0.03584 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_487 (PointWiseV2) [06/13/2021-16:49:31] [V] [TRT] Tactic: 24 time 0.026624 [06/13/2021-16:49:31] [V] [TRT] Tactic: 25 time 0.026624 [06/13/2021-16:49:31] [V] [TRT] Tactic: 26 time 0.028672 [06/13/2021-16:49:31] [V] [TRT] Tactic: 27 time 0.0256 [06/13/2021-16:49:31] [V] [TRT] Tactic: 31 time 0.0256 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 27 Time: 0.0256 [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_488 (FusedConvActConvolution) [06/13/2021-16:49:31] [V] [TRT] Tactic: 524287 time 0.54368 [06/13/2021-16:49:31] [V] [TRT] Tactic: 720895 time 0.473088 [06/13/2021-16:49:31] [V] [TRT] Tactic: 983039 time 0.475136 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1048575 time 0.4944 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1703935 time 0.478208 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1769471 time 0.64512 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1966079 time 0.483328 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2031615 time 0.494592 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2228223 time 0.523264 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2424831 time 0.797696 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2621439 time 0.500736 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2752511 time 0.529408 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2818047 time 0.761856 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2883583 time 0.530432 [06/13/2021-16:49:31] [V] [TRT] Tactic: 3014655 time 0.493568 [06/13/2021-16:49:31] [V] [TRT] Tactic: 3145727 time 0.50176 [06/13/2021-16:49:31] [V] [TRT] Tactic: 3473407 time 0.494592 [06/13/2021-16:49:31] [V] [TRT] Tactic: 3604479 time 0.484352 [06/13/2021-16:49:31] [V] [TRT] Tactic: 3735551 time 0.484352 [06/13/2021-16:49:31] [V] [TRT] Tactic: 4390911 time 0.55808 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5046271 time 0.521216 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5963775 time 0.507904 [06/13/2021-16:49:31] [V] [TRT] Tactic: 6160383 time 0.54272 [06/13/2021-16:49:31] [V] [TRT] Tactic: 6488063 time 0.564224 [06/13/2021-16:49:31] [V] [TRT] Tactic: 6881279 time 0.528384 [06/13/2021-16:49:31] [V] [TRT] Tactic: 7274495 time 0.569344 [06/13/2021-16:49:31] [V] [TRT] Tactic: 7864319 time 0.585728 [06/13/2021-16:49:31] [V] [TRT] Tactic: 7995391 time 0.473088 [06/13/2021-16:49:31] [V] [TRT] Tactic: 8585215 time 0.550912 [06/13/2021-16:49:31] [V] [TRT] Tactic: 8847359 time 0.611328 [06/13/2021-16:49:31] [V] [TRT] Tactic: 8978431 time 0.519168 [06/13/2021-16:49:31] [V] [TRT] Tactic: 9043967 time 0.544768 [06/13/2021-16:49:31] [V] [TRT] Tactic: 9175039 time 0.4864 [06/13/2021-16:49:31] [V] [TRT] Tactic: 9502719 time 0.5632 [06/13/2021-16:49:31] [V] [TRT] Tactic: 9830399 time 0.484352 [06/13/2021-16:49:31] [V] [TRT] Tactic: 9961471 time 0.551936 [06/13/2021-16:49:31] [V] [TRT] Tactic: 10027007 time 0.505856 [06/13/2021-16:49:31] [V] [TRT] Tactic: 10092543 time 0.5632 [06/13/2021-16:49:31] [V] [TRT] Tactic: 10289151 time 0.487424 [06/13/2021-16:49:31] [V] [TRT] Tactic: 10485759 time 0.499712 [06/13/2021-16:49:31] [V] [TRT] Tactic: 10682367 time 0.498688 [06/13/2021-16:49:31] [V] [TRT] Tactic: 10813439 time 0.45568 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 10813439 Time: 0.45568 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_488 (CaskConvolution) [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1062367460111450758 time 0.545792 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1754984623894446479 time 0.611328 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: 3611739942397549984 time 0.4864 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 3827454225649558724 time 0.24064 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 4337000649858996379 time 0.49152 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 4501471010995462441 time 0.487424 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5137655947464784826 time 0.466944 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5288347012147084929 time 0.477184 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5921334924264294896 time 0.253952 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 6645123197870846056 time 0.482304 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: 7144526460361122478 time 0.57856 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 7852627285308570038 time 0.259072 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: -9137461792520977713 time 0.49664 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -8776506421218919509 time 0.241664 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -8262349710178828730 time 0.488448 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -8133971918129952780 time 0.553984 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: -6092040395344634144 time 0.58368 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -4787320710726427159 time 0.613376 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: -3456450830548107839 time 0.509952 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -2318106587342035239 time 0.252928 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -1343271414618805657 time 0.260096 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -1218658103698133241 time 0.55296 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -836875257600482091 time 0.528384 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: -410470605513481746 time 0.475136 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 3827454225649558724 Time: 0.24064 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_488 (CudaConvolution) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.740352 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1 time 0.534528 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2 time 0.771072 [06/13/2021-16:49:31] [V] [TRT] Tactic: 4 skipped. Scratch requested: 4380295168, available: 524288000 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5 time 7.00416 [06/13/2021-16:49:31] [V] [TRT] Tactic: 6 time 0.303104 [06/13/2021-16:49:31] [V] [TRT] Tactic: 56 time 0.739328 [06/13/2021-16:49:31] [V] [TRT] Tactic: 57 time 0.534528 [06/13/2021-16:49:31] [V] [TRT] Tactic: 58 time 0.770048 [06/13/2021-16:49:31] [V] [TRT] Tactic: 60 skipped. Scratch requested: 4380295168, available: 524288000 [06/13/2021-16:49:31] [V] [TRT] Tactic: 61 time 7.00314 [06/13/2021-16:49:31] [V] [TRT] Tactic: 62 time 0.303104 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 6 Time: 0.303104 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_488 (CudaDepthwiseConvolution) [06/13/2021-16:49:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_488 (CublasConvolution) [06/13/2021-16:49:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3827454225649558724 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_488 (FusedConvActConvolution) [06/13/2021-16:49:31] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_488 (CaskConvolution) [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: -9153228964338181824 time 0.437248 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: -7394439838318485025 time 0.420864 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: -7394439838318485025 Time: 0.420864 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_488 (CudaConvolution) [06/13/2021-16:49:31] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_488 (CudaDepthwiseConvolution) [06/13/2021-16:49:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_488 (CublasConvolution) [06/13/2021-16:49:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_488 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_489 (PointWise) [06/13/2021-16:49:31] [V] [TRT] Tactic: 128 time 0.068608 [06/13/2021-16:49:31] [V] [TRT] Tactic: 256 time 0.068608 [06/13/2021-16:49:31] [V] [TRT] Tactic: 512 time 0.069632 [06/13/2021-16:49:31] [V] [TRT] Tactic: -32 time 0.09216 [06/13/2021-16:49:31] [V] [TRT] Tactic: -64 time 0.074752 [06/13/2021-16:49:31] [V] [TRT] Tactic: -128 time 0.072704 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 128 Time: 0.068608 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_489 (PointWiseV2) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.045056 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1 time 0.044032 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2 time 0.044032 [06/13/2021-16:49:31] [V] [TRT] Tactic: 3 time 0.044032 [06/13/2021-16:49:31] [V] [TRT] Tactic: 4 time 0.044032 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5 time 0.044032 [06/13/2021-16:49:31] [V] [TRT] Tactic: 6 time 0.044032 [06/13/2021-16:49:31] [V] [TRT] Tactic: 7 time 0.045056 [06/13/2021-16:49:31] [V] [TRT] Tactic: 8 time 0.044032 [06/13/2021-16:49:31] [V] [TRT] Tactic: 9 time 0.044032 [06/13/2021-16:49:31] [V] [TRT] Tactic: 28 time 0.045056 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 1 Time: 0.044032 [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_489 (PointWise) [06/13/2021-16:49:31] [V] [TRT] Tactic: 128 time 0.068608 [06/13/2021-16:49:31] [V] [TRT] Tactic: 256 time 0.068608 [06/13/2021-16:49:31] [V] [TRT] Tactic: 512 time 0.069632 [06/13/2021-16:49:31] [V] [TRT] Tactic: -32 time 0.093184 [06/13/2021-16:49:31] [V] [TRT] Tactic: -64 time 0.074752 [06/13/2021-16:49:31] [V] [TRT] Tactic: -128 time 0.072704 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 128 Time: 0.068608 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_489 (PointWiseV2) [06/13/2021-16:49:31] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,32768) -> Float(1,64,4096:32,32768) *************** [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_489 (PointWise) [06/13/2021-16:49:31] [V] [TRT] Tactic: 128 time 0.068608 [06/13/2021-16:49:31] [V] [TRT] Tactic: 256 time 0.068608 [06/13/2021-16:49:31] [V] [TRT] Tactic: 512 time 0.069632 [06/13/2021-16:49:31] [V] [TRT] Tactic: -32 time 0.09216 [06/13/2021-16:49:31] [V] [TRT] Tactic: -64 time 0.074752 [06/13/2021-16:49:31] [V] [TRT] Tactic: -128 time 0.072704 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 128 Time: 0.068608 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: LeakyRelu_489 (PointWiseV2) [06/13/2021-16:49:31] [V] [TRT] Tactic: 24 time 0.0512 [06/13/2021-16:49:31] [V] [TRT] Tactic: 25 time 0.0512 [06/13/2021-16:49:31] [V] [TRT] Tactic: 26 time 0.052224 [06/13/2021-16:49:31] [V] [TRT] Tactic: 27 time 0.054272 [06/13/2021-16:49:31] [V] [TRT] Tactic: 31 time 0.050176 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 31 Time: 0.050176 [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,32768) -> Float(1,64,4096:32,32768) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,524288) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(128,8192,1,524288) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,16384) -> Float(1,64,4096:32,16384) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:31] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,524288) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_844 (FusedConvActConvolution) [06/13/2021-16:49:31] [V] [TRT] Tactic: 458751 time 0.191488 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 458751 Time: 0.191488 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_844 (CaskConvolution) [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1062367460111450758 time 0.182272 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1754984623894446479 time 0.16384 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: 3611739942397549984 time 0.188416 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 4337000649858996379 time 0.15872 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 4501471010995462441 time 0.188416 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5137655947464784826 time 0.151552 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5288347012147084929 time 0.185344 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: 6645123197870846056 time 0.156672 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: 7144526460361122478 time 0.1536 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: -9137461792520977713 time 0.192512 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -8262349710178828730 time 0.18944 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -8133971918129952780 time 0.181248 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: -6092040395344634144 time 0.185344 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -4787320710726427159 time 0.162816 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: -3456450830548107839 time 0.166912 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -1218658103698133241 time 0.178176 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:31] [V] [TRT] Tactic: -836875257600482091 time 0.173056 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] Tactic: -410470605513481746 time 0.186368 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.151552 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_844 (CudaConvolution) [06/13/2021-16:49:31] [V] [TRT] Tactic: 0 time 0.256 [06/13/2021-16:49:31] [V] [TRT] Tactic: 1 time 0.180224 [06/13/2021-16:49:31] [V] [TRT] Tactic: 2 time 0.279552 [06/13/2021-16:49:31] [V] [TRT] Tactic: 5 time 6.97222 [06/13/2021-16:49:31] [V] [TRT] Tactic: 56 time 0.254976 [06/13/2021-16:49:31] [V] [TRT] Tactic: 57 time 0.1792 [06/13/2021-16:49:31] [V] [TRT] Tactic: 58 time 0.280576 [06/13/2021-16:49:31] [V] [TRT] Tactic: 61 time 6.96013 [06/13/2021-16:49:31] [V] [TRT] Fastest Tactic: 57 Time: 0.1792 [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_844 (CudaDepthwiseConvolution) [06/13/2021-16:49:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] --------------- Timing Runner: Conv_844 (CublasConvolution) [06/13/2021-16:49:31] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:31] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:31] [V] [TRT] [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(128,8192,1,524288) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_844 (FusedConvActConvolution) [06/13/2021-16:49:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_844 (CaskConvolution) [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: -9153228964338181824 time 0.129024 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: -7394439838318485025 time 0.149504 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.129024 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_844 (CudaConvolution) [06/13/2021-16:49:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_844 (CudaDepthwiseConvolution) [06/13/2021-16:49:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_844 (CublasConvolution) [06/13/2021-16:49:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:32] [V] [TRT] [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1048576) *************** [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(256,16384,1,1048576) *************** [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,32768) -> Float(1,64,4096:32,32768) *************** [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,1048576) -> Float(1,64,4096,1044480) *************** [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_498 (FusedConvActConvolution) [06/13/2021-16:49:32] [V] [TRT] Tactic: 589823 time 0.36352 [06/13/2021-16:49:32] [V] [TRT] Tactic: 786431 time 0.297984 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1310719 time 1.06291 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1638399 time 0.32256 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1835007 time 0.299008 [06/13/2021-16:49:32] [V] [TRT] Tactic: 2097151 time 0.328704 [06/13/2021-16:49:32] [V] [TRT] Tactic: 3997695 time 0.2816 [06/13/2021-16:49:32] [V] [TRT] Tactic: 4194303 time 0.303104 [06/13/2021-16:49:32] [V] [TRT] Tactic: 4259839 time 0.303104 [06/13/2021-16:49:32] [V] [TRT] Tactic: 4325375 time 0.294912 [06/13/2021-16:49:32] [V] [TRT] Tactic: 4521983 time 0.306176 [06/13/2021-16:49:32] [V] [TRT] Tactic: 4587519 time 0.294912 [06/13/2021-16:49:32] [V] [TRT] Tactic: 4915199 time 0.289728 [06/13/2021-16:49:32] [V] [TRT] Tactic: 4980735 time 0.313344 [06/13/2021-16:49:32] [V] [TRT] Tactic: 5439487 time 0.493568 [06/13/2021-16:49:32] [V] [TRT] Tactic: 5767167 time 1.32301 [06/13/2021-16:49:32] [V] [TRT] Tactic: 6750207 time 0.333824 [06/13/2021-16:49:32] [V] [TRT] Tactic: 6946815 time 0.433152 [06/13/2021-16:49:32] [V] [TRT] Tactic: 7012351 time 0.329728 [06/13/2021-16:49:32] [V] [TRT] Tactic: 7143423 time 0.49664 [06/13/2021-16:49:32] [V] [TRT] Tactic: 7602175 time 0.319328 [06/13/2021-16:49:32] [V] [TRT] Tactic: 7798783 time 0.300032 [06/13/2021-16:49:32] [V] [TRT] Tactic: 8191999 time 0.425984 [06/13/2021-16:49:32] [V] [TRT] Tactic: 8257535 time 0.285696 [06/13/2021-16:49:32] [V] [TRT] Tactic: 8323071 time 0.347136 [06/13/2021-16:49:32] [V] [TRT] Tactic: 8650751 time 0.339968 [06/13/2021-16:49:32] [V] [TRT] Tactic: 9109503 time 0.32768 [06/13/2021-16:49:32] [V] [TRT] Tactic: 9568255 time 0.288768 [06/13/2021-16:49:32] [V] [TRT] Tactic: 9895935 time 0.305152 [06/13/2021-16:49:32] [V] [TRT] Tactic: 10354687 time 0.283648 [06/13/2021-16:49:32] [V] [TRT] Tactic: 10551295 time 0.350208 [06/13/2021-16:49:32] [V] [TRT] Tactic: 10944511 time 0.313344 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 3997695 Time: 0.2816 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_498 (CaskConvolution) [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1062367460111450758 time 0.15872 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1698681053543049347 time 0.136192 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: 4501471010995462441 time 0.130048 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: 5137655947464784826 time 0.124928 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Tactic: 5288347012147084929 time 0.131072 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: 5326823351883942011 time 0.124928 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Tactic: 5500448035057547314 time 0.14432 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: 6645123197870846056 time 0.129024 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Tactic: 7144526460361122478 time 0.17408 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Tactic: -8262349710178828730 time 0.132224 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: -6576203419454146580 time 0.144384 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Tactic: -4787320710726427159 time 0.176928 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: -3456450830548107839 time 0.156672 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Tactic: -1218658103698133241 time 0.151552 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Tactic: -836875257600482091 time 0.14848 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: -410470605513481746 time 0.128 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Tactic: -377491875521947884 time 0.131072 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Tactic: -37215280111360163 time 0.124928 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.124928 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_498 (CudaConvolution) [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.299008 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1 time 0.173056 [06/13/2021-16:49:32] [V] [TRT] Tactic: 2 time 0.366592 [06/13/2021-16:49:32] [V] [TRT] Tactic: 4 skipped. Scratch requested: 2214853632, available: 524288000 [06/13/2021-16:49:32] [V] [TRT] Tactic: 5 time 0.422912 [06/13/2021-16:49:32] [V] [TRT] Tactic: 56 time 0.297984 [06/13/2021-16:49:32] [V] [TRT] Tactic: 57 time 0.173056 [06/13/2021-16:49:32] [V] [TRT] Tactic: 58 time 0.367616 [06/13/2021-16:49:32] [V] [TRT] Tactic: 60 skipped. Scratch requested: 2214853632, available: 524288000 [06/13/2021-16:49:32] [V] [TRT] Tactic: 61 time 0.421888 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1 Time: 0.173056 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_498 (CudaDepthwiseConvolution) [06/13/2021-16:49:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_498 (CublasConvolution) [06/13/2021-16:49:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:32] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(256,16384,1,1048576) -> Float(255,16320,1,1044480) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_498 (FusedConvActConvolution) [06/13/2021-16:49:32] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_498 (CaskConvolution) [06/13/2021-16:49:32] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_498 (CudaConvolution) [06/13/2021-16:49:32] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_498 (CudaDepthwiseConvolution) [06/13/2021-16:49:32] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Conv_498 (CublasConvolution) [06/13/2021-16:49:32] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.053248 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.06352 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.053248 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.054272 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.087008 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.054272 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_503 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_503 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_503 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_503 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_503 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_503 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_508 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_508 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_508 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_508 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_513 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_513 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_518 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_518 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.02048 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.02048 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_518 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.031744 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.03072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.03072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_518 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.021472 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.030688 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.021472 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_518 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.041984 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_518 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.038912 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.045056 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.038912 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_523 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_523 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_523 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.01024 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_523 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_523 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_523 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_528 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_528 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_528 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_528 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_533 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_533 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_538 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.01536 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_538 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.021504 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_538 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.032768 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.03072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.03072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_538 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.029696 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.021504 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_538 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.043008 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_538 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.037888 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.041984 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.037888 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_543 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_543 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_543 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.012288 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.011264 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_543 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_543 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_543 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.013312 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.009216 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_548 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_548 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_548 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_548 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.028672 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_553 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_553 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_558 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_558 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.02048 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.02048 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_558 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.031744 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.034816 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.031744 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_558 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.022528 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.03072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.022528 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_558 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.041984 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.018432 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.018432 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_558 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.038912 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.049152 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.038912 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,24576) -> Float(1,64,4096,24576) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Exp_615 (Unary) [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(6,384,1,24576) -> Float(6,384,1,24576) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Exp_615 (Unary) [06/13/2021-16:49:32] [V] [TRT] Unary has no valid tactics for this config, skipping [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,12288) -> Float(1,12288) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Reshape_577 (Shuffle) [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.049152 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.059392 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.049152 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.077824 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.086016 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.077824 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.050176 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.080064 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.050176 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.093184 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.129024 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.093184 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.115712 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.06144 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.06144 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.08704 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.058368 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.058368 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,983040) -> Float(1,80,327680,983040) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Reshape_592 + Transpose_593 (Shuffle) [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.06144 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1 time 0.106496 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.06144 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(240,15360,1,983040) -> Float(3,240,1,983040) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Reshape_592 + Transpose_593 (Shuffle) [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.193536 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1 time 0.397312 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.193536 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,32768) -> Float(1,80,327680:32,327680) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Reshape_592 + Transpose_593 (Shuffle) [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 2.78323 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1 time 0.830464 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1 Time: 0.830464 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_636 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_636 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_636 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_636 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_643 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_643 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_643 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_643 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_664 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.005056 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_664 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.005088 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_664 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_664 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_671 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_671 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_671 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_671 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_692 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_692 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_692 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_692 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_699 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_699 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_699 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Slice_699 (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,12288) -> Float(1,12288) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Sigmoid_616 (Activation) [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.320512 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.079872 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.079872 [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:32] [V] [TRT] Tactic: 1002 time 0.1792 [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.173056 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.173056 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,80,327680,983040) -> Float(1,80,983040) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Reshape_609 (Shuffle) [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.043008 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1 time 0.103424 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.043008 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,12288) -> Float(1,1,12288) *************** [06/13/2021-16:49:32] [V] [TRT] --------------- Timing Runner: Reshape_842 (Shuffle) [06/13/2021-16:49:32] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:32] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:32] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:32] [V] [TRT] *************** Autotuning format combination: Float(1,80,983040), Float(1,1,12288) -> Float(1,80,983040) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_617, Mul_843) (PointWise) [06/13/2021-16:49:34] [V] [TRT] Tactic: 128 time 0.088064 [06/13/2021-16:49:34] [V] [TRT] Tactic: 256 time 0.088064 [06/13/2021-16:49:34] [V] [TRT] Tactic: 512 time 0.088064 [06/13/2021-16:49:34] [V] [TRT] Tactic: -32 time 0.100352 [06/13/2021-16:49:34] [V] [TRT] Tactic: -64 time 0.130048 [06/13/2021-16:49:34] [V] [TRT] Tactic: -128 time 0.114688 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 128 Time: 0.088064 [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_617, Mul_843) (PointWiseV2) [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.058368 [06/13/2021-16:49:34] [V] [TRT] Tactic: 1 time 0.0512 [06/13/2021-16:49:34] [V] [TRT] Tactic: 2 time 0.050176 [06/13/2021-16:49:34] [V] [TRT] Tactic: 3 time 0.044032 [06/13/2021-16:49:34] [V] [TRT] Tactic: 4 time 0.044032 [06/13/2021-16:49:34] [V] [TRT] Tactic: 5 time 0.044032 [06/13/2021-16:49:34] [V] [TRT] Tactic: 6 time 0.058368 [06/13/2021-16:49:34] [V] [TRT] Tactic: 7 time 0.047104 [06/13/2021-16:49:34] [V] [TRT] Tactic: 8 time 0.047104 [06/13/2021-16:49:34] [V] [TRT] Tactic: 9 time 0.045056 [06/13/2021-16:49:34] [V] [TRT] Tactic: 28 time 0.048128 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 3 Time: 0.044032 [06/13/2021-16:49:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 3 [06/13/2021-16:49:34] [V] [TRT] [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:34] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:34] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1401 + (Unnamed Layer* 615) [Shuffle] + Mul_638 (Scale) [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.004032 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1401 + (Unnamed Layer* 615) [Shuffle] + Mul_638 (Scale) [06/13/2021-16:49:34] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:34] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:34] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1408 + (Unnamed Layer* 619) [Shuffle] + Mul_645 (Scale) [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1408 + (Unnamed Layer* 619) [Shuffle] + Mul_645 (Scale) [06/13/2021-16:49:34] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1429 + (Unnamed Layer* 629) [Shuffle] + Mul_666 (Scale) [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1429 + (Unnamed Layer* 629) [Shuffle] + Mul_666 (Scale) [06/13/2021-16:49:34] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1436 + (Unnamed Layer* 633) [Shuffle] + Mul_673 (Scale) [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1436 + (Unnamed Layer* 633) [Shuffle] + Mul_673 (Scale) [06/13/2021-16:49:34] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1457 + (Unnamed Layer* 643) [Shuffle] + Mul_694 (Scale) [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1457 + (Unnamed Layer* 643) [Shuffle] + Mul_694 (Scale) [06/13/2021-16:49:34] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1464 + (Unnamed Layer* 647) [Shuffle] + Mul_701 (Scale) [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: 1464 + (Unnamed Layer* 647) [Shuffle] + Mul_701 (Scale) [06/13/2021-16:49:34] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,16384) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:34] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.011264 [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:34] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.009216 [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:34] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:34] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:34] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:34] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:34] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,24576) -> Float(1,64,4096,24576) *************** [06/13/2021-16:49:36] [V] [TRT] --------------- Timing Runner: PWN(1377 + (Unnamed Layer* 602) [Shuffle], PWN(PWN(Sigmoid_610, 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612), Sub_614)) (PointWise) [06/13/2021-16:49:36] [V] [TRT] Tactic: 128 time 0.006144 [06/13/2021-16:49:36] [V] [TRT] Tactic: 256 time 0.006144 [06/13/2021-16:49:36] [V] [TRT] Tactic: 512 time 0.007168 [06/13/2021-16:49:36] [V] [TRT] Tactic: -32 time 0.041984 [06/13/2021-16:49:36] [V] [TRT] Tactic: -64 time 0.022528 [06/13/2021-16:49:36] [V] [TRT] Tactic: -128 time 0.013312 [06/13/2021-16:49:36] [V] [TRT] Fastest Tactic: 128 Time: 0.006144 [06/13/2021-16:49:36] [V] [TRT] --------------- Timing Runner: PWN(1377 + (Unnamed Layer* 602) [Shuffle], PWN(PWN(Sigmoid_610, 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612), Sub_614)) (PointWiseV2) [06/13/2021-16:49:36] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:36] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:36] [V] [TRT] Tactic: 2 time 0.004096 [06/13/2021-16:49:36] [V] [TRT] Tactic: 3 time 0.004096 [06/13/2021-16:49:36] [V] [TRT] Tactic: 4 time 0.004096 [06/13/2021-16:49:36] [V] [TRT] Tactic: 5 time 0.004096 [06/13/2021-16:49:36] [V] [TRT] Tactic: 6 time 0.00512 [06/13/2021-16:49:36] [V] [TRT] Tactic: 7 time 0.004096 [06/13/2021-16:49:36] [V] [TRT] Tactic: 8 time 0.004096 [06/13/2021-16:49:36] [V] [TRT] Tactic: 9 time 0.004096 [06/13/2021-16:49:36] [V] [TRT] Tactic: 28 time 0.004096 [06/13/2021-16:49:36] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [06/13/2021-16:49:36] [V] [TRT] [06/13/2021-16:49:36] [V] [TRT] *************** Autotuning format combination: Float(6,384,1,24576) -> Float(6,384,1,24576) *************** [06/13/2021-16:49:36] [V] [TRT] --------------- Timing Runner: PWN(1377 + (Unnamed Layer* 602) [Shuffle], PWN(PWN(Sigmoid_610, 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612), Sub_614)) (PointWise) [06/13/2021-16:49:36] [V] [TRT] Tactic: 128 time 0.006144 [06/13/2021-16:49:36] [V] [TRT] Tactic: 256 time 0.006144 [06/13/2021-16:49:36] [V] [TRT] Tactic: 512 time 0.007168 [06/13/2021-16:49:36] [V] [TRT] Tactic: -32 time 0.04096 [06/13/2021-16:49:36] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:36] [V] [TRT] Tactic: -128 time 0.013312 [06/13/2021-16:49:36] [V] [TRT] Fastest Tactic: 128 Time: 0.006144 [06/13/2021-16:49:36] [V] [TRT] --------------- Timing Runner: PWN(1377 + (Unnamed Layer* 602) [Shuffle], PWN(PWN(Sigmoid_610, 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612), Sub_614)) (PointWiseV2) [06/13/2021-16:49:36] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:36] [V] [TRT] [06/13/2021-16:49:36] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,4096) -> Float(1,64,4096:32,4096) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: PWN(1377 + (Unnamed Layer* 602) [Shuffle], PWN(PWN(Sigmoid_610, 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612), Sub_614)) (PointWise) [06/13/2021-16:49:37] [V] [TRT] Tactic: 128 time 0.018432 [06/13/2021-16:49:37] [V] [TRT] Tactic: 256 time 0.018432 [06/13/2021-16:49:37] [V] [TRT] Tactic: 512 time 0.019456 [06/13/2021-16:49:37] [V] [TRT] Tactic: -32 time 0.044032 [06/13/2021-16:49:37] [V] [TRT] Tactic: -64 time 0.026624 [06/13/2021-16:49:37] [V] [TRT] Tactic: -128 time 0.02048 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 128 Time: 0.018432 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: PWN(1377 + (Unnamed Layer* 602) [Shuffle], PWN(PWN(Sigmoid_610, 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612), Sub_614)) (PointWiseV2) [06/13/2021-16:49:37] [V] [TRT] Tactic: 24 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 25 time 0.006144 [06/13/2021-16:49:37] [V] [TRT] Tactic: 26 time 0.008192 [06/13/2021-16:49:37] [V] [TRT] Tactic: 27 time 0.011264 [06/13/2021-16:49:37] [V] [TRT] Tactic: 31 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 25 Time: 0.006144 [06/13/2021-16:49:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [06/13/2021-16:49:37] [V] [TRT] [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.011264 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.009216 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_622 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_622 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_622 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_622 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_622 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_622 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_629 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_629 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_629 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_629 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_629 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_629 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_650 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_650 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_650 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_650 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_650 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_650 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_657 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_657 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_657 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_657 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_657 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_657 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_678 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_678 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_678 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_678 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_678 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_678 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_685 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_685 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_685 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_685 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_685 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: Slice_685 (Reformat) [06/13/2021-16:49:37] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1387 + Add_624 (Scale) [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1387 + Add_624 (Scale) [06/13/2021-16:49:37] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1394 + Add_631 (Scale) [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1394 + Add_631 (Scale) [06/13/2021-16:49:37] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1415 + Add_652 (Scale) [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1415 + Add_652 (Scale) [06/13/2021-16:49:37] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1422 + Add_659 (Scale) [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1422 + Add_659 (Scale) [06/13/2021-16:49:37] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1443 + Add_680 (Scale) [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1443 + Add_680 (Scale) [06/13/2021-16:49:37] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,4096) -> Float(1,64,4096,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1450 + Add_687 (Scale) [06/13/2021-16:49:37] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:37] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:37] [V] [TRT] *************** Autotuning format combination: Float(1,64,1,4096) -> Float(3,192,1,12288) *************** [06/13/2021-16:49:37] [V] [TRT] --------------- Timing Runner: 1450 + Add_687 (Scale) [06/13/2021-16:49:37] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1466 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1466 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1466 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1466 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1468 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1468 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.01024 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.013312 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.01024 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1468 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1468 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.013312 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1467 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1467 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1467 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1467 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1469 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1469 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.013312 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.011264 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1469 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: 1469 copy (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.013312 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.009216 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,24576), Float(1,1,1,1) -> Float(1,64,4096,24576) *************** [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Div_712 (ElementWise) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Tactic: 2 time 0.013312 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,4096), Float(1,1,1:32,1) -> Float(1,64,4096:32,4096) *************** [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Div_712 (ElementWise) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1 time 0.008192 [06/13/2021-16:49:38] [V] [TRT] Tactic: 2 time 0.013312 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 1 Time: 0.008192 [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,24576), Float(1,1,1,1) -> Float(1,64,4096,24576) *************** [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Div_717 (ElementWise) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Tactic: 2 time 0.013312 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096:32,4096), Float(1,1,1:32,1) -> Float(1,64,4096:32,4096) *************** [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Div_717 (ElementWise) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1 time 0.009216 [06/13/2021-16:49:38] [V] [TRT] Tactic: 2 time 0.013312 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 1 Time: 0.009216 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Slice_722 (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Slice_722 (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Slice_764 (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Slice_764 (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Slice_743 (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Slice_743 (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Slice_785 (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Slice_785 (Reformat) [06/13/2021-16:49:38] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,12288) -> Float(1,1,12288) *************** [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Reshape_738 (Shuffle) [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Tactic: 1 time 0.007168 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,12288) -> Float(1,1,12288) *************** [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Reshape_780 (Shuffle) [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Tactic: 1 time 0.007168 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,12288) -> Float(1,1,12288) *************** [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Reshape_759 (Shuffle) [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Tactic: 1 time 0.007168 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,64,4096,12288) -> Float(1,1,12288) *************** [06/13/2021-16:49:38] [V] [TRT] --------------- Timing Runner: Reshape_801 (Shuffle) [06/13/2021-16:49:38] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:38] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:38] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,16384) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:38] [V] [TRT] *************** Autotuning format combination: Float(1,1,12288), Float(1,1,12288) -> Float(1,1,12288) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(1574 + (Unnamed Layer* 740) [Shuffle], Mul_803), Sub_804) (PointWise) [06/13/2021-16:49:40] [V] [TRT] Tactic: 128 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 256 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 512 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: -32 time 0.023552 [06/13/2021-16:49:40] [V] [TRT] Tactic: -64 time 0.014336 [06/13/2021-16:49:40] [V] [TRT] Tactic: -128 time 0.009216 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 128 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: PWN(PWN(1574 + (Unnamed Layer* 740) [Shuffle], Mul_803), Sub_804) (PointWiseV2) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 2 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 3 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 6 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 7 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 8 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 9 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 28 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:40] [V] [TRT] [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,1,12288), Float(1,1,12288) -> Float(1,1,12288) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,1,12288), Float(1,1,12288) -> Float(1,1,12288) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Add_808 (ElementWise) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Tactic: 2 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,1,12288), Float(1,1,12288) -> Float(1,1,12288) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Add_809 (ElementWise) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Tactic: 2 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1576 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1579 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1580 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1581 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,4,49152) -> Float(1,4,4,49152) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Reshape_826 (Shuffle) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.008448 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,262144) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(256,8192,1,262144) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,32,1024:32,8192) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,262144) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_1205 (FusedConvActConvolution) [06/13/2021-16:49:40] [V] [TRT] Tactic: 458751 time 0.269312 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 458751 Time: 0.269312 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_1205 (CaskConvolution) [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1062367460111450758 time 0.280576 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1754984623894446479 time 0.275456 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: 3611739942397549984 time 0.243712 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4337000649858996379 time 0.227328 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4501471010995462441 time 0.249856 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5137655947464784826 time 0.203776 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5288347012147084929 time 0.241664 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: 6645123197870846056 time 0.22016 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: 7144526460361122478 time 0.26112 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: -9137461792520977713 time 0.26624 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: -8262349710178828730 time 0.243712 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: -8133971918129952780 time 0.328704 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: -6092040395344634144 time 0.303104 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: -4787320710726427159 time 0.273024 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: -3456450830548107839 time 0.256 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: -1218658103698133241 time 0.326656 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: -836875257600482091 time 0.308224 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: -410470605513481746 time 0.24576 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.203776 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_1205 (CudaConvolution) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.318464 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.26112 [06/13/2021-16:49:40] [V] [TRT] Tactic: 2 time 0.279552 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5 skipped. Scratch requested: 577110016, available: 524288000 [06/13/2021-16:49:40] [V] [TRT] Tactic: 56 time 0.31744 [06/13/2021-16:49:40] [V] [TRT] Tactic: 57 time 0.2568 [06/13/2021-16:49:40] [V] [TRT] Tactic: 58 time 0.279552 [06/13/2021-16:49:40] [V] [TRT] Tactic: 61 skipped. Scratch requested: 577110016, available: 524288000 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 57 Time: 0.2568 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_1205 (CudaDepthwiseConvolution) [06/13/2021-16:49:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_1205 (CublasConvolution) [06/13/2021-16:49:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(256,8192,1,262144) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_1205 (FusedConvActConvolution) [06/13/2021-16:49:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_1205 (CaskConvolution) [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: -9153228964338181824 time 0.149504 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: -7394439838318485025 time 0.180224 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: -9153228964338181824 Time: 0.149504 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_1205 (CudaConvolution) [06/13/2021-16:49:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_1205 (CudaDepthwiseConvolution) [06/13/2021-16:49:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_1205 (CublasConvolution) [06/13/2021-16:49:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:40] [V] [TRT] [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,524288) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(512,16384,1,524288) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,16384) -> Float(1,32,1024:32,16384) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 2012 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 2012 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 2012 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 2012 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 2012 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.019456 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 2012 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1058 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1058 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1058 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1058 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1058 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.019456 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1058 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,524288) -> Float(1,32,1024,261120) *************** [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_859 (FusedConvActConvolution) [06/13/2021-16:49:40] [V] [TRT] Tactic: 589823 time 0.195584 [06/13/2021-16:49:40] [V] [TRT] Tactic: 786431 time 0.157696 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1310719 time 0.287744 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1638399 time 0.162816 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1835007 time 0.1536 [06/13/2021-16:49:40] [V] [TRT] Tactic: 2097151 time 0.142336 [06/13/2021-16:49:40] [V] [TRT] Tactic: 3997695 time 0.145408 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4194303 time 0.150528 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4259839 time 0.133056 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4325375 time 0.147456 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4521983 time 0.151552 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4587519 time 0.135168 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4915199 time 0.140288 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4980735 time 0.164864 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5439487 time 0.236544 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5767167 time 0.478208 [06/13/2021-16:49:40] [V] [TRT] Tactic: 6750207 time 0.144608 [06/13/2021-16:49:40] [V] [TRT] Tactic: 6946815 time 0.183232 [06/13/2021-16:49:40] [V] [TRT] Tactic: 7012351 time 0.142336 [06/13/2021-16:49:40] [V] [TRT] Tactic: 7143423 time 0.244736 [06/13/2021-16:49:40] [V] [TRT] Tactic: 7602175 time 0.146432 [06/13/2021-16:49:40] [V] [TRT] Tactic: 7798783 time 0.158592 [06/13/2021-16:49:40] [V] [TRT] Tactic: 8191999 time 0.185344 [06/13/2021-16:49:40] [V] [TRT] Tactic: 8257535 time 0.136192 [06/13/2021-16:49:40] [V] [TRT] Tactic: 8323071 time 0.160768 [06/13/2021-16:49:40] [V] [TRT] Tactic: 8650751 time 0.1536 [06/13/2021-16:49:40] [V] [TRT] Tactic: 9109503 time 0.144384 [06/13/2021-16:49:40] [V] [TRT] Tactic: 9568255 time 0.139264 [06/13/2021-16:49:40] [V] [TRT] Tactic: 9895935 time 0.151552 [06/13/2021-16:49:40] [V] [TRT] Tactic: 10354687 time 0.131072 [06/13/2021-16:49:40] [V] [TRT] Tactic: 10551295 time 0.16384 [06/13/2021-16:49:40] [V] [TRT] Tactic: 10944511 time 0.162816 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 10354687 Time: 0.131072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_859 (CaskConvolution) [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1062367460111450758 time 0.088064 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1698681053543049347 time 0.070656 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4501471010995462441 time 0.088064 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5137655947464784826 time 0.075776 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5288347012147084929 time 0.08704 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5326823351883942011 time 0.086016 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5500448035057547314 time 0.082944 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: 6645123197870846056 time 0.0768 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: 7144526460361122478 time 0.074752 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: -8262349710178828730 time 0.089088 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: -6576203419454146580 time 0.077824 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: -4787320710726427159 time 0.077824 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: -3456450830548107839 time 0.09216 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: -1218658103698133241 time 0.08992 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: -836875257600482091 time 0.08704 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: -410470605513481746 time 0.08704 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Tactic: -377491875521947884 time 0.086016 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Tactic: -37215280111360163 time 0.072704 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1698681053543049347 Time: 0.070656 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_859 (CudaConvolution) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.146432 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.117664 [06/13/2021-16:49:40] [V] [TRT] Tactic: 2 time 0.219136 [06/13/2021-16:49:40] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1141372928, available: 524288000 [06/13/2021-16:49:40] [V] [TRT] Tactic: 5 time 0.37888 [06/13/2021-16:49:40] [V] [TRT] Tactic: 56 time 0.145408 [06/13/2021-16:49:40] [V] [TRT] Tactic: 57 time 0.115712 [06/13/2021-16:49:40] [V] [TRT] Tactic: 58 time 0.22016 [06/13/2021-16:49:40] [V] [TRT] Tactic: 60 skipped. Scratch requested: 1141372928, available: 524288000 [06/13/2021-16:49:40] [V] [TRT] Tactic: 61 time 0.376832 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 57 Time: 0.115712 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_859 (CudaDepthwiseConvolution) [06/13/2021-16:49:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_859 (CublasConvolution) [06/13/2021-16:49:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:40] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(512,16384,1,524288) -> Float(255,8160,1,261120) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_859 (FusedConvActConvolution) [06/13/2021-16:49:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_859 (CaskConvolution) [06/13/2021-16:49:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_859 (CudaConvolution) [06/13/2021-16:49:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_859 (CudaDepthwiseConvolution) [06/13/2021-16:49:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Conv_859 (CublasConvolution) [06/13/2021-16:49:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.016384 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_864 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_864 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004064 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_869 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_869 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004064 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_874 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_874 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_879 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_879 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.007168 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_884 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_884 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004064 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_889 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_889 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003872 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_894 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_894 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003968 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_899 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_899 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.008096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_904 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_904 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004032 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_909 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_909 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_914 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_914 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.005088 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_919 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004064 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_919 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.008096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.007168 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1649 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1649 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.005056 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1649 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1669 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1669 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004032 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1669 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1689 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1689 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1689 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1654 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1654 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1674 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1674 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1694 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1694 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1659 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1679 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1699 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1664 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1664 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1664 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1684 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1684 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1684 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1704 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1704 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.008192 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.007168 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: 1704 copy (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.012288 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.011264 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,6144) -> Float(1,32,1024,6144) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Exp_976 (Unary) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(6,192,1,6144) -> Float(6,192,1,6144) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Exp_976 (Unary) [06/13/2021-16:49:40] [V] [TRT] Unary has no valid tactics for this config, skipping [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,3072) -> Float(1,3072) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Reshape_938 (Shuffle) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.01536 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.014336 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.02048 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.024576 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.02048 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.013312 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.013312 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.03072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.021504 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.032768 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.017408 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.021504 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.017408 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,245760) -> Float(1,80,81920,245760) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Reshape_953 + Transpose_954 (Shuffle) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.015552 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.028672 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.015552 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(240,7680,1,245760) -> Float(3,240,1,245760) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Reshape_953 + Transpose_954 (Shuffle) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.029696 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.101376 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.029696 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,8192) -> Float(1,80,81920:32,81920) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Reshape_953 + Transpose_954 (Shuffle) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.712704 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.22528 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1 Time: 0.22528 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_997 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_997 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_997 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_997 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1004 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1004 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1004 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1004 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1025 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1025 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1025 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1025 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1032 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1032 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1032 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1032 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1053 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1053 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1053 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1053 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1060 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1060 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1060 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Slice_1060 (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,3072) -> Float(1,3072) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Sigmoid_977 (Activation) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.078848 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.014336 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:40] [V] [TRT] Tactic: 1002 time 0.050176 [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.04608 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.04608 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,81920,245760) -> Float(1,80,245760) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Reshape_970 (Shuffle) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.026624 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,3072) -> Float(1,1,3072) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: Reshape_1203 (Shuffle) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,245760), Float(1,1,3072) -> Float(1,80,245760) *************** [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_978, Mul_1204) (PointWise) [06/13/2021-16:49:40] [V] [TRT] Tactic: 128 time 0.024576 [06/13/2021-16:49:40] [V] [TRT] Tactic: 256 time 0.024576 [06/13/2021-16:49:40] [V] [TRT] Tactic: 512 time 0.024576 [06/13/2021-16:49:40] [V] [TRT] Tactic: -32 time 0.027648 [06/13/2021-16:49:40] [V] [TRT] Tactic: -64 time 0.03584 [06/13/2021-16:49:40] [V] [TRT] Tactic: -128 time 0.03072 [06/13/2021-16:49:40] [V] [TRT] Fastest Tactic: 128 Time: 0.024576 [06/13/2021-16:49:40] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_978, Mul_1204) (PointWiseV2) [06/13/2021-16:49:40] [V] [TRT] Tactic: 0 time 0.017408 [06/13/2021-16:49:40] [V] [TRT] Tactic: 1 time 0.01536 [06/13/2021-16:49:41] [V] [TRT] Tactic: 2 time 0.014336 [06/13/2021-16:49:41] [V] [TRT] Tactic: 3 time 0.012288 [06/13/2021-16:49:41] [V] [TRT] Tactic: 4 time 0.011264 [06/13/2021-16:49:41] [V] [TRT] Tactic: 5 time 0.011264 [06/13/2021-16:49:41] [V] [TRT] Tactic: 6 time 0.014336 [06/13/2021-16:49:41] [V] [TRT] Tactic: 7 time 0.013312 [06/13/2021-16:49:41] [V] [TRT] Tactic: 8 time 0.013312 [06/13/2021-16:49:41] [V] [TRT] Tactic: 9 time 0.012288 [06/13/2021-16:49:41] [V] [TRT] Tactic: 28 time 0.014336 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 4 Time: 0.011264 [06/13/2021-16:49:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [06/13/2021-16:49:41] [V] [TRT] [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1789 + (Unnamed Layer* 886) [Shuffle] + Mul_999 (Scale) [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1789 + (Unnamed Layer* 886) [Shuffle] + Mul_999 (Scale) [06/13/2021-16:49:41] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1796 + (Unnamed Layer* 890) [Shuffle] + Mul_1006 (Scale) [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1796 + (Unnamed Layer* 890) [Shuffle] + Mul_1006 (Scale) [06/13/2021-16:49:41] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1817 + (Unnamed Layer* 900) [Shuffle] + Mul_1027 (Scale) [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1817 + (Unnamed Layer* 900) [Shuffle] + Mul_1027 (Scale) [06/13/2021-16:49:41] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1824 + (Unnamed Layer* 904) [Shuffle] + Mul_1034 (Scale) [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1824 + (Unnamed Layer* 904) [Shuffle] + Mul_1034 (Scale) [06/13/2021-16:49:41] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1845 + (Unnamed Layer* 914) [Shuffle] + Mul_1055 (Scale) [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1845 + (Unnamed Layer* 914) [Shuffle] + Mul_1055 (Scale) [06/13/2021-16:49:41] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1852 + (Unnamed Layer* 918) [Shuffle] + Mul_1062 (Scale) [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1852 + (Unnamed Layer* 918) [Shuffle] + Mul_1062 (Scale) [06/13/2021-16:49:41] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1790 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1790 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1818 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1818 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1846 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1846 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1797 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1797 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1825 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1825 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1853 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: 1853 copy (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,8192) -> Float(1,16,256:32,8192) *************** [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.00512 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:41] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:41] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:41] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:41] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,6144) -> Float(1,32,1024,6144) *************** [06/13/2021-16:49:43] [V] [TRT] --------------- Timing Runner: PWN(1765 + (Unnamed Layer* 873) [Shuffle], PWN(PWN(Sigmoid_971, 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973), Sub_975)) (PointWise) [06/13/2021-16:49:43] [V] [TRT] Tactic: 128 time 0.00512 [06/13/2021-16:49:43] [V] [TRT] Tactic: 256 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: 512 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: -32 time 0.041984 [06/13/2021-16:49:43] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:43] [V] [TRT] Tactic: -128 time 0.013312 [06/13/2021-16:49:43] [V] [TRT] Fastest Tactic: 256 Time: 0.004096 [06/13/2021-16:49:43] [V] [TRT] --------------- Timing Runner: PWN(1765 + (Unnamed Layer* 873) [Shuffle], PWN(PWN(Sigmoid_971, 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973), Sub_975)) (PointWiseV2) [06/13/2021-16:49:43] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:43] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: 2 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: 3 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: 4 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: 5 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: 6 time 0.00512 [06/13/2021-16:49:43] [V] [TRT] Tactic: 7 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: 8 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: 9 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: 28 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [06/13/2021-16:49:43] [V] [TRT] [06/13/2021-16:49:43] [V] [TRT] *************** Autotuning format combination: Float(6,192,1,6144) -> Float(6,192,1,6144) *************** [06/13/2021-16:49:43] [V] [TRT] --------------- Timing Runner: PWN(1765 + (Unnamed Layer* 873) [Shuffle], PWN(PWN(Sigmoid_971, 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973), Sub_975)) (PointWise) [06/13/2021-16:49:43] [V] [TRT] Tactic: 128 time 0.00512 [06/13/2021-16:49:43] [V] [TRT] Tactic: 256 time 0.00512 [06/13/2021-16:49:43] [V] [TRT] Tactic: 512 time 0.004096 [06/13/2021-16:49:43] [V] [TRT] Tactic: -32 time 0.041984 [06/13/2021-16:49:43] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:43] [V] [TRT] Tactic: -128 time 0.013312 [06/13/2021-16:49:43] [V] [TRT] Fastest Tactic: 512 Time: 0.004096 [06/13/2021-16:49:43] [V] [TRT] --------------- Timing Runner: PWN(1765 + (Unnamed Layer* 873) [Shuffle], PWN(PWN(Sigmoid_971, 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973), Sub_975)) (PointWiseV2) [06/13/2021-16:49:43] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 512 [06/13/2021-16:49:43] [V] [TRT] [06/13/2021-16:49:43] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,1024) -> Float(1,32,1024:32,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: PWN(1765 + (Unnamed Layer* 873) [Shuffle], PWN(PWN(Sigmoid_971, 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973), Sub_975)) (PointWise) [06/13/2021-16:49:44] [V] [TRT] Tactic: 128 time 0.008192 [06/13/2021-16:49:44] [V] [TRT] Tactic: 256 time 0.008192 [06/13/2021-16:49:44] [V] [TRT] Tactic: 512 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: -32 time 0.041984 [06/13/2021-16:49:44] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:44] [V] [TRT] Tactic: -128 time 0.014336 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 512 Time: 0.007168 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: PWN(1765 + (Unnamed Layer* 873) [Shuffle], PWN(PWN(Sigmoid_971, 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973), Sub_975)) (PointWiseV2) [06/13/2021-16:49:44] [V] [TRT] Tactic: 24 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 25 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 26 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 27 time 0.011264 [06/13/2021-16:49:44] [V] [TRT] Tactic: 31 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 24 Time: 0.00512 [06/13/2021-16:49:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [06/13/2021-16:49:44] [V] [TRT] [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_983 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_983 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_983 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_983 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_983 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_983 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_990 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_990 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_990 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_990 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_990 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_990 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1011 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1011 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1011 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1011 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1011 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1011 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1018 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1018 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1018 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1018 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1018 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1018 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1039 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1039 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1039 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003872 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003872 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1039 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.005024 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003968 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1039 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007072 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003968 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1039 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1046 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1046 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1046 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1046 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1046 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1046 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1775 + Add_985 (Scale) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1775 + Add_985 (Scale) [06/13/2021-16:49:44] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1782 + Add_992 (Scale) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1782 + Add_992 (Scale) [06/13/2021-16:49:44] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1803 + Add_1013 (Scale) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1803 + Add_1013 (Scale) [06/13/2021-16:49:44] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1810 + Add_1020 (Scale) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1810 + Add_1020 (Scale) [06/13/2021-16:49:44] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1831 + Add_1041 (Scale) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1831 + Add_1041 (Scale) [06/13/2021-16:49:44] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,1024) -> Float(1,32,1024,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1838 + Add_1048 (Scale) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1,1024) -> Float(1,32,1,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1838 + Add_1048 (Scale) [06/13/2021-16:49:44] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1776 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1776 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1804 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1804 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1832 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1832 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1783 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1783 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1811 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1811 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1839 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1839 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1854 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1854 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1856 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1856 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1855 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1855 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1857 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1857 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,6144), Float(1,1,1,1) -> Float(1,32,1024,6144) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Div_1073 (ElementWise) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 2 time 0.012288 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,1024), Float(1,1,1:32,1) -> Float(1,32,1024:32,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Div_1073 (ElementWise) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 2 time 0.013312 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,6144), Float(1,1,1,1) -> Float(1,32,1024,6144) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Div_1078 (ElementWise) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 2 time 0.013312 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024:32,1024), Float(1,1,1:32,1) -> Float(1,32,1024:32,1024) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Div_1078 (ElementWise) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 2 time 0.012288 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1 Time: 0.00512 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1083 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1083 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1125 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1125 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1104 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1104 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1146 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1146 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,3072) -> Float(1,1,3072) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Reshape_1099 (Shuffle) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,3072) -> Float(1,1,3072) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Reshape_1141 (Shuffle) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,3072) -> Float(1,1,3072) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Reshape_1120 (Shuffle) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,32,1024,3072) -> Float(1,1,3072) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Reshape_1162 (Shuffle) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,8192) -> Float(1,16,256:32,8192) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,1,3072), Float(1,1,3072) -> Float(1,1,3072) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(1962 + (Unnamed Layer* 1011) [Shuffle], Mul_1164), Sub_1165) (PointWise) [06/13/2021-16:49:44] [V] [TRT] Tactic: 128 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 256 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 512 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: -32 time 0.023552 [06/13/2021-16:49:44] [V] [TRT] Tactic: -64 time 0.014336 [06/13/2021-16:49:44] [V] [TRT] Tactic: -128 time 0.009216 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 128 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: PWN(PWN(1962 + (Unnamed Layer* 1011) [Shuffle], Mul_1164), Sub_1165) (PointWiseV2) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 2 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Tactic: 3 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 4 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 5 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 6 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 7 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 8 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 9 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 28 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [06/13/2021-16:49:44] [V] [TRT] [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,1,3072), Float(1,1,3072) -> Float(1,1,3072) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,1,3072), Float(1,1,3072) -> Float(1,1,3072) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Add_1169 (ElementWise) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Tactic: 2 time 0.008192 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,1,3072), Float(1,1,3072) -> Float(1,1,3072) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Add_1170 (ElementWise) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Tactic: 2 time 0.008192 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1964 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1967 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1968 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 1969 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,4,12288) -> Float(1,4,4,12288) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Reshape_1187 (Shuffle) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.007168 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,131072) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(512,8192,1,131072) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,4096) -> Float(1,16,256:32,4096) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,131072) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(512,8192,1,131072) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,262144) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(1024,16384,1,262144) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,8192) -> Float(1,16,256:32,8192) *************** [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,262144) -> Float(1,16,256,65280) *************** [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Conv_1220 (FusedConvActConvolution) [06/13/2021-16:49:44] [V] [TRT] Tactic: 589823 time 0.328704 [06/13/2021-16:49:44] [V] [TRT] Tactic: 786431 time 0.093184 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1310719 time 0.257024 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1638399 time 0.09728 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1835007 time 0.077824 [06/13/2021-16:49:44] [V] [TRT] Tactic: 2097151 time 0.09216 [06/13/2021-16:49:44] [V] [TRT] Tactic: 3997695 time 0.094208 [06/13/2021-16:49:44] [V] [TRT] Tactic: 4194303 time 0.084992 [06/13/2021-16:49:44] [V] [TRT] Tactic: 4259839 time 0.069632 [06/13/2021-16:49:44] [V] [TRT] Tactic: 4325375 time 0.082944 [06/13/2021-16:49:44] [V] [TRT] Tactic: 4521983 time 0.197632 [06/13/2021-16:49:44] [V] [TRT] Tactic: 4587519 time 0.083968 [06/13/2021-16:49:44] [V] [TRT] Tactic: 4915199 time 0.08704 [06/13/2021-16:49:44] [V] [TRT] Tactic: 4980735 time 0.111616 [06/13/2021-16:49:44] [V] [TRT] Tactic: 5439487 time 0.08704 [06/13/2021-16:49:44] [V] [TRT] Tactic: 5767167 time 0.135168 [06/13/2021-16:49:44] [V] [TRT] Tactic: 6750207 time 0.08704 [06/13/2021-16:49:44] [V] [TRT] Tactic: 6946815 time 0.086016 [06/13/2021-16:49:44] [V] [TRT] Tactic: 7012351 time 0.09216 [06/13/2021-16:49:44] [V] [TRT] Tactic: 7143423 time 0.126976 [06/13/2021-16:49:44] [V] [TRT] Tactic: 7602175 time 0.086016 [06/13/2021-16:49:44] [V] [TRT] Tactic: 7798783 time 0.093184 [06/13/2021-16:49:44] [V] [TRT] Tactic: 8191999 time 0.089088 [06/13/2021-16:49:44] [V] [TRT] Tactic: 8257535 time 0.089088 [06/13/2021-16:49:44] [V] [TRT] Tactic: 8323071 time 0.086016 [06/13/2021-16:49:44] [V] [TRT] Tactic: 8650751 time 0.086016 [06/13/2021-16:49:44] [V] [TRT] Tactic: 9109503 time 0.084992 [06/13/2021-16:49:44] [V] [TRT] Tactic: 9568255 time 0.088064 [06/13/2021-16:49:44] [V] [TRT] Tactic: 9895935 time 0.084992 [06/13/2021-16:49:44] [V] [TRT] Tactic: 10354687 time 0.069632 [06/13/2021-16:49:44] [V] [TRT] Tactic: 10551295 time 0.11776 [06/13/2021-16:49:44] [V] [TRT] Tactic: 10944511 time 0.11264 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 4259839 Time: 0.069632 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Conv_1220 (CaskConvolution) [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1062367460111450758 time 0.105472 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1698681053543049347 time 0.109568 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Tactic: 4501471010995462441 time 0.101376 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Tactic: 5137655947464784826 time 0.082944 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Tactic: 5288347012147084929 time 0.1024 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Tactic: 5326823351883942011 time 0.100352 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Tactic: 5500448035057547314 time 0.129024 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Tactic: 6645123197870846056 time 0.088064 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Tactic: 7144526460361122478 time 0.11264 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Tactic: -8262349710178828730 time 0.105472 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Tactic: -6576203419454146580 time 0.090112 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Tactic: -4787320710726427159 time 0.120832 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Tactic: -3456450830548107839 time 0.093184 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Tactic: -1218658103698133241 time 0.135168 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Tactic: -836875257600482091 time 0.131072 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Tactic: -410470605513481746 time 0.099328 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 [06/13/2021-16:49:44] [V] [TRT] Tactic: -377491875521947884 time 0.1024 [06/13/2021-16:49:44] [V] [TRT] Conv_1220 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:44] [V] [TRT] Tactic: -37215280111360163 time 0.079872 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.079872 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Conv_1220 (CudaConvolution) [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.095232 [06/13/2021-16:49:44] [V] [TRT] Tactic: 1 time 0.079872 [06/13/2021-16:49:44] [V] [TRT] Tactic: 2 time 0.172032 [06/13/2021-16:49:44] [V] [TRT] Tactic: 4 skipped. Scratch requested: 605024256, available: 524288000 [06/13/2021-16:49:44] [V] [TRT] Tactic: 5 time 0.6144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 56 time 0.09728 [06/13/2021-16:49:44] [V] [TRT] Tactic: 57 time 0.079872 [06/13/2021-16:49:44] [V] [TRT] Tactic: 58 time 0.167936 [06/13/2021-16:49:44] [V] [TRT] Tactic: 60 skipped. Scratch requested: 605024256, available: 524288000 [06/13/2021-16:49:44] [V] [TRT] Tactic: 61 time 0.62464 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1 Time: 0.079872 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Conv_1220 (CudaDepthwiseConvolution) [06/13/2021-16:49:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Conv_1220 (CublasConvolution) [06/13/2021-16:49:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4259839 [06/13/2021-16:49:44] [V] [TRT] [06/13/2021-16:49:44] [V] [TRT] *************** Autotuning format combination: Float(1024,16384,1,262144) -> Float(255,4080,1,65280) *************** [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Conv_1220 (FusedConvActConvolution) [06/13/2021-16:49:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Conv_1220 (CaskConvolution) [06/13/2021-16:49:44] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Conv_1220 (CudaConvolution) [06/13/2021-16:49:44] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Conv_1220 (CudaDepthwiseConvolution) [06/13/2021-16:49:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Conv_1220 (CublasConvolution) [06/13/2021-16:49:44] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1225 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1225 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1230 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1230 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1235 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1235 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1240 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1240 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.00512 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1245 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1245 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1250 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1250 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1255 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1255 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1260 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1260 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.00512 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1265 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1265 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1270 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1270 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1275 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1275 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1280 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: Slice_1280 (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.00512 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2037 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2037 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2037 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2057 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2057 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2057 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2077 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2077 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2077 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2042 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2042 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2062 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2062 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2082 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2082 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2047 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2067 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2087 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:44] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:44] [V] [TRT] --------------- Timing Runner: 2052 copy (Reformat) [06/13/2021-16:49:44] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2052 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.00512 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2052 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2072 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2072 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.00512 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2072 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2092 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2092 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.00512 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2092 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,1536) -> Float(1,16,256,1536) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Exp_1337 (Unary) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(6,96,1,1536) -> Float(6,96,1,1536) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Exp_1337 (Unary) [06/13/2021-16:49:45] [V] [TRT] Unary has no valid tactics for this config, skipping [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,768) -> Float(1,768) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Reshape_1299 (Shuffle) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.007168 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.008192 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.009216 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.008192 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.011264 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.009216 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.011264 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.007168 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.009216 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.007168 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.007168 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,61440) -> Float(1,80,20480,61440) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Reshape_1314 + Transpose_1315 (Shuffle) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 1 time 0.009216 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(240,3840,1,61440) -> Float(3,240,1,61440) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Reshape_1314 + Transpose_1315 (Shuffle) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.01024 [06/13/2021-16:49:45] [V] [TRT] Tactic: 1 time 0.028672 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,2048) -> Float(1,80,20480:32,20480) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Reshape_1314 + Transpose_1315 (Shuffle) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.11776 [06/13/2021-16:49:45] [V] [TRT] Tactic: 1 time 0.058368 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1 Time: 0.058368 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1358 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1358 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1358 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1358 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1365 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1365 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1365 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1365 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1386 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1386 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1386 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1386 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1393 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1393 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1393 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1393 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1414 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1414 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1414 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1414 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1421 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1421 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1421 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Slice_1421 (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,768) -> Float(1,768) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Sigmoid_1338 (Activation) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 is the only option, timing skipped [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.022528 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.014336 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.013312 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.013312 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,80,20480,61440) -> Float(1,80,61440) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Reshape_1331 (Shuffle) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 1 time 0.008192 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,768) -> Float(1,1,768) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: Reshape_1564 (Shuffle) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,80,61440), Float(1,1,768) -> Float(1,80,61440) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_1339, Mul_1565) (PointWise) [06/13/2021-16:49:45] [V] [TRT] Tactic: 128 time 0.009216 [06/13/2021-16:49:45] [V] [TRT] Tactic: 256 time 0.008192 [06/13/2021-16:49:45] [V] [TRT] Tactic: 512 time 0.009216 [06/13/2021-16:49:45] [V] [TRT] Tactic: -32 time 0.01024 [06/13/2021-16:49:45] [V] [TRT] Tactic: -64 time 0.012288 [06/13/2021-16:49:45] [V] [TRT] Tactic: -128 time 0.011264 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 256 Time: 0.008192 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: PWN(Sigmoid_1339, Mul_1565) (PointWiseV2) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.007168 [06/13/2021-16:49:45] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 2 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 3 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 4 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 5 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 6 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 7 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 8 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 9 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 28 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 4 Time: 0.00512 [06/13/2021-16:49:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 4 [06/13/2021-16:49:45] [V] [TRT] [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 1621 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.055296 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.048128 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.048128 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2009 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.012288 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.014336 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.012288 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2397 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.006144 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.006144 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2177 + (Unnamed Layer* 1157) [Shuffle] + Mul_1360 (Scale) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2177 + (Unnamed Layer* 1157) [Shuffle] + Mul_1360 (Scale) [06/13/2021-16:49:45] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2184 + (Unnamed Layer* 1161) [Shuffle] + Mul_1367 (Scale) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2184 + (Unnamed Layer* 1161) [Shuffle] + Mul_1367 (Scale) [06/13/2021-16:49:45] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2205 + (Unnamed Layer* 1171) [Shuffle] + Mul_1388 (Scale) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2205 + (Unnamed Layer* 1171) [Shuffle] + Mul_1388 (Scale) [06/13/2021-16:49:45] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2212 + (Unnamed Layer* 1175) [Shuffle] + Mul_1395 (Scale) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2212 + (Unnamed Layer* 1175) [Shuffle] + Mul_1395 (Scale) [06/13/2021-16:49:45] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2233 + (Unnamed Layer* 1185) [Shuffle] + Mul_1416 (Scale) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2233 + (Unnamed Layer* 1185) [Shuffle] + Mul_1416 (Scale) [06/13/2021-16:49:45] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2240 + (Unnamed Layer* 1189) [Shuffle] + Mul_1423 (Scale) [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2240 + (Unnamed Layer* 1189) [Shuffle] + Mul_1423 (Scale) [06/13/2021-16:49:45] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2178 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2178 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2206 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2206 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2234 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2234 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2185 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2185 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2213 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2213 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2241 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: 2241 copy (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:45] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:45] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,1536) -> Float(1,16,256,1536) *************** [06/13/2021-16:49:47] [V] [TRT] --------------- Timing Runner: PWN(2153 + (Unnamed Layer* 1144) [Shuffle], PWN(PWN(Sigmoid_1332, 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334), Sub_1336)) (PointWise) [06/13/2021-16:49:47] [V] [TRT] Tactic: 128 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 256 time 0.00496 [06/13/2021-16:49:47] [V] [TRT] Tactic: 512 time 0.00512 [06/13/2021-16:49:47] [V] [TRT] Tactic: -32 time 0.031744 [06/13/2021-16:49:47] [V] [TRT] Tactic: -64 time 0.018432 [06/13/2021-16:49:47] [V] [TRT] Tactic: -128 time 0.011264 [06/13/2021-16:49:47] [V] [TRT] Fastest Tactic: 128 Time: 0.004096 [06/13/2021-16:49:47] [V] [TRT] --------------- Timing Runner: PWN(2153 + (Unnamed Layer* 1144) [Shuffle], PWN(PWN(Sigmoid_1332, 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334), Sub_1336)) (PointWiseV2) [06/13/2021-16:49:47] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:47] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 2 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 3 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 4 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 5 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 6 time 0.00512 [06/13/2021-16:49:47] [V] [TRT] Tactic: 7 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 8 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 9 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 28 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [06/13/2021-16:49:47] [V] [TRT] [06/13/2021-16:49:47] [V] [TRT] *************** Autotuning format combination: Float(6,96,1,1536) -> Float(6,96,1,1536) *************** [06/13/2021-16:49:47] [V] [TRT] --------------- Timing Runner: PWN(2153 + (Unnamed Layer* 1144) [Shuffle], PWN(PWN(Sigmoid_1332, 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334), Sub_1336)) (PointWise) [06/13/2021-16:49:47] [V] [TRT] Tactic: 128 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 256 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: 512 time 0.004096 [06/13/2021-16:49:47] [V] [TRT] Tactic: -32 time 0.031744 [06/13/2021-16:49:47] [V] [TRT] Tactic: -64 time 0.018432 [06/13/2021-16:49:47] [V] [TRT] Tactic: -128 time 0.011264 [06/13/2021-16:49:47] [V] [TRT] Fastest Tactic: 128 Time: 0.004096 [06/13/2021-16:49:47] [V] [TRT] --------------- Timing Runner: PWN(2153 + (Unnamed Layer* 1144) [Shuffle], PWN(PWN(Sigmoid_1332, 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334), Sub_1336)) (PointWiseV2) [06/13/2021-16:49:47] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [06/13/2021-16:49:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [06/13/2021-16:49:47] [V] [TRT] [06/13/2021-16:49:47] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,256) -> Float(1,16,256:32,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: PWN(2153 + (Unnamed Layer* 1144) [Shuffle], PWN(PWN(Sigmoid_1332, 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334), Sub_1336)) (PointWise) [06/13/2021-16:49:48] [V] [TRT] Tactic: 128 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 256 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 512 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: -32 time 0.041984 [06/13/2021-16:49:48] [V] [TRT] Tactic: -64 time 0.023552 [06/13/2021-16:49:48] [V] [TRT] Tactic: -128 time 0.013312 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 128 Time: 0.00512 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: PWN(2153 + (Unnamed Layer* 1144) [Shuffle], PWN(PWN(Sigmoid_1332, 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334), Sub_1336)) (PointWiseV2) [06/13/2021-16:49:48] [V] [TRT] Tactic: 24 time 0.005088 [06/13/2021-16:49:48] [V] [TRT] Tactic: 25 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 26 time 0.007168 [06/13/2021-16:49:48] [V] [TRT] Tactic: 27 time 0.011264 [06/13/2021-16:49:48] [V] [TRT] Tactic: 31 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 31 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [06/13/2021-16:49:48] [V] [TRT] [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00608 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003936 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003936 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1344 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1344 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004064 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1344 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1344 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1344 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1344 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1351 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1351 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1351 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1351 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1351 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1351 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1372 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1372 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1372 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1372 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1372 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1372 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1379 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1379 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1379 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1379 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1379 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1379 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1400 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1400 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1400 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1400 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1400 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1400 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00608 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1407 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1407 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1407 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1407 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1407 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1407 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2163 + Add_1346 (Scale) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2163 + Add_1346 (Scale) [06/13/2021-16:49:48] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2170 + Add_1353 (Scale) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004064 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2170 + Add_1353 (Scale) [06/13/2021-16:49:48] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2191 + Add_1374 (Scale) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2191 + Add_1374 (Scale) [06/13/2021-16:49:48] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2198 + Add_1381 (Scale) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2198 + Add_1381 (Scale) [06/13/2021-16:49:48] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2219 + Add_1402 (Scale) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2219 + Add_1402 (Scale) [06/13/2021-16:49:48] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,256) -> Float(1,16,256,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2226 + Add_1409 (Scale) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,1,256) -> Float(1,16,1,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2226 + Add_1409 (Scale) [06/13/2021-16:49:48] [V] [TRT] Scale has no valid tactics for this config, skipping [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2164 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2164 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2192 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2192 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004064 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2220 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2220 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2171 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2171 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2199 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2199 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2227 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2227 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2242 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2242 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2244 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2244 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2243 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2243 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2245 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2245 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.006112 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,1536), Float(1,1,1,1) -> Float(1,16,256,1536) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Div_1434 (ElementWise) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 2 time 0.01024 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,256), Float(1,1,1:32,1) -> Float(1,16,256:32,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Div_1434 (ElementWise) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 2 time 0.012288 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,1536), Float(1,1,1,1) -> Float(1,16,256,1536) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Div_1439 (ElementWise) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 2 time 0.01024 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256:32,256), Float(1,1,1:32,1) -> Float(1,16,256:32,256) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Div_1439 (ElementWise) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 2 time 0.012288 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1444 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1444 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1486 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1486 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1465 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1465 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.007168 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1507 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Slice_1507 (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.007104 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004064 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004064 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,768) -> Float(1,1,768) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Reshape_1460 (Shuffle) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,768) -> Float(1,1,768) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Reshape_1502 (Shuffle) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,768) -> Float(1,1,768) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Reshape_1481 (Shuffle) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,16,256,768) -> Float(1,1,768) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Reshape_1523 (Shuffle) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,1,768), Float(1,1,768) -> Float(1,1,768) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: PWN(PWN(2350 + (Unnamed Layer* 1282) [Shuffle], Mul_1525), Sub_1526) (PointWise) [06/13/2021-16:49:48] [V] [TRT] Tactic: 128 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 256 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 512 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: -32 time 0.018432 [06/13/2021-16:49:48] [V] [TRT] Tactic: -64 time 0.011264 [06/13/2021-16:49:48] [V] [TRT] Tactic: -128 time 0.007168 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 128 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: PWN(PWN(2350 + (Unnamed Layer* 1282) [Shuffle], Mul_1525), Sub_1526) (PointWiseV2) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 2 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 3 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 4 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 5 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 6 time 0.005088 [06/13/2021-16:49:48] [V] [TRT] Tactic: 7 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 8 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 9 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 28 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 1 [06/13/2021-16:49:48] [V] [TRT] [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,1,768), Float(1,1,768) -> Float(1,1,768) *************** [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,1,768), Float(1,1,768) -> Float(1,1,768) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Add_1530 (ElementWise) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 2 time 0.007168 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,1,768), Float(1,1,768) -> Float(1,1,768) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Add_1531 (ElementWise) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 2 time 0.007168 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2352 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2355 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2356 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00512 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2357 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 1002 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,4,3072) -> Float(1,4,4,3072) *************** [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: Reshape_1548 (Shuffle) [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Tactic: 1 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 1602 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.006144 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 1990 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.00496 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.004032 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004032 [06/13/2021-16:49:48] [V] [TRT] --------------- Timing Runner: 2378 copy (Reformat) [06/13/2021-16:49:48] [V] [TRT] Tactic: 1002 time 0.004096 [06/13/2021-16:49:48] [V] [TRT] Tactic: 0 time 0.003072 [06/13/2021-16:49:48] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: Conv_166 reformatted input 0 (852) from Float(1,64,4096,1048576) to Float(256,16384,1,1048576) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: PWN(PWN(Softplus_167, Tanh_168), Mul_169) reformatted input 0 (2514) from Float(512,16384,1,524288) to Float(1,32,1024,524288) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: Conv_259 reformatted input 0 (966) from Float(1,32,1024,524288) to Float(512,16384,1,524288) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: PWN(PWN(Softplus_260, Tanh_261), Mul_262) reformatted input 0 (2577) from Float(1024,16384,1,262144) to Float(1,16,256,262144) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: Conv_316 reformatted input 0 (1036) from Float(1,16,256,262144) to Float(1024,16384,1,262144) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: LeakyRelu_317 reformatted input 0 (2616) from Float(512,8192,1,131072) to Float(1,16,256,131072) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: MaxPool_322 output to be reformatted 0 (1046) from Float(2048,32768,1,524288) to Float(1,16,256,524288) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: MaxPool_323 output to be reformatted 0 (1047) from Float(2048,32768,1,524288) to Float(1,16,256,524288) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: MaxPool_324 output to be reformatted 0 (1048) from Float(2048,32768,1,524288) to Float(1,16,256,524288) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: LeakyRelu_327 reformatted input 0 (2625) from Float(512,8192,1,131072) to Float(1,16,256,131072) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: Conv_1205 reformatted input 0 (1640) from Float(1,32,1024,262144) to Float(256,8192,1,262144) [06/13/2021-16:49:48] [V] [TRT] Adding reformat layer: LeakyRelu_1209 reformatted input 0 (2703) from Float(512,8192,1,131072) to Float(1,16,256,131072) [06/13/2021-16:49:48] [V] [TRT] Formats and tactics selection completed in 50.3617 seconds. [06/13/2021-16:49:48] [V] [TRT] After reformat layers: 506 layers [06/13/2021-16:49:48] [V] [TRT] Block size 524288000 [06/13/2021-16:49:48] [V] [TRT] Block size 33554432 [06/13/2021-16:49:48] [V] [TRT] Block size 33554432 [06/13/2021-16:49:48] [V] [TRT] Block size 16777216 [06/13/2021-16:49:48] [V] [TRT] Block size 16777216 [06/13/2021-16:49:48] [V] [TRT] Block size 4194304 [06/13/2021-16:49:48] [V] [TRT] Block size 1048576 [06/13/2021-16:49:48] [V] [TRT] Block size 524288 [06/13/2021-16:49:48] [V] [TRT] Block size 196608 [06/13/2021-16:49:48] [V] [TRT] Block size 49152 [06/13/2021-16:49:48] [V] [TRT] Block size 49152 [06/13/2021-16:49:48] [V] [TRT] Block size 16384 [06/13/2021-16:49:48] [V] [TRT] Block size 16384 [06/13/2021-16:49:48] [V] [TRT] Block size 16384 [06/13/2021-16:49:48] [V] [TRT] Block size 16384 [06/13/2021-16:49:48] [V] [TRT] Block size 4096 [06/13/2021-16:49:48] [V] [TRT] Block size 4096 [06/13/2021-16:49:48] [V] [TRT] Block size 4096 [06/13/2021-16:49:48] [V] [TRT] Block size 1024 [06/13/2021-16:49:48] [V] [TRT] Block size 512 [06/13/2021-16:49:48] [V] [TRT] Block size 512 [06/13/2021-16:49:48] [V] [TRT] Block size 512 [06/13/2021-16:49:48] [V] [TRT] Block size 1 [06/13/2021-16:49:48] [V] [TRT] Block size 1 [06/13/2021-16:49:48] [V] [TRT] Block size 1 [06/13/2021-16:49:48] [V] [TRT] Block size 1 [06/13/2021-16:49:48] [V] [TRT] Block size 1 [06/13/2021-16:49:48] [V] [TRT] Block size 1 [06/13/2021-16:49:48] [V] [TRT] Block size 1 [06/13/2021-16:49:48] [V] [TRT] Total Activation Memory: 631093767 [06/13/2021-16:49:48] [I] [TRT] Detected 1 inputs and 8 output network tensors. [06/13/2021-16:49:48] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_8 || Conv_12 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_20 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_25 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_30 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_34 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_38 || Conv_42 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_55 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_59 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_64 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_69 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_73 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_77 || Conv_81 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_85 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_89 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_94 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_98 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_103 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_107 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_112 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_116 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_121 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_125 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_130 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_134 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_139 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_143 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_148 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_152 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_157 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_162 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_166 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_483 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_170 || Conv_174 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_178 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_182 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_187 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_191 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_196 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_200 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_209 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_214 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_218 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_223 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_227 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_232 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_236 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_241 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_245 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_250 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_255 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_259 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_401 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_263 || Conv_267 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_271 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_275 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_280 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_284 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_289 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_293 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_298 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_302 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_307 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_312 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_316 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_318 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_320 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_326 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_328 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_330 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_404 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_406 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_408 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_410 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_412 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_414 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_486 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_488 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_490 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_492 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_494 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_496 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_844 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_498 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_847 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_849 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_851 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_853 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_855 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_857 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_1205 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_859 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_1208 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_1210 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_1212 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_1214 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Conv_1216 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [06/13/2021-16:49:48] [V] [TRT] Conv_1218 (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2255[Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1867[Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1479[Constant] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_0 Weights: 0 HostPersistent: 1664 DevicePersistent: 1576960 [06/13/2021-16:49:48] [V] [TRT] Layer: Cast_1438 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Cast_1433 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Cast_1077 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Cast_1072 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Cast_716 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Cast_711 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_1, Tanh_2), Mul_3) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_4 Weights: 0 HostPersistent: 1664 DevicePersistent: 467456 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_5, Tanh_6), Mul_7) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_8 || Conv_12 Weights: 0 HostPersistent: 3200 DevicePersistent: 427008 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_13, Tanh_14), Mul_15) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_16 Weights: 0 HostPersistent: 3200 DevicePersistent: 401920 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_17, Tanh_18), Mul_19) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_20 Weights: 0 HostPersistent: 512 DevicePersistent: 205312 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_21, Tanh_22), Mul_23), Add_24) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_25 Weights: 0 HostPersistent: 1664 DevicePersistent: 410112 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_9, Tanh_10), Mul_11) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_26, Tanh_27), Mul_28) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_30 Weights: 0 HostPersistent: 1664 DevicePersistent: 426496 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_31, Tanh_32), Mul_33) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_34 Weights: 0 HostPersistent: 1664 DevicePersistent: 394240 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_35, Tanh_36), Mul_37) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_38 || Conv_42 Weights: 0 HostPersistent: 3200 DevicePersistent: 164864 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_43, Tanh_44), Mul_45) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_46 Weights: 0 HostPersistent: 1664 DevicePersistent: 115200 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_47, Tanh_48), Mul_49) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_50 Weights: 0 HostPersistent: 512 DevicePersistent: 410112 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_51, Tanh_52), Mul_53), Add_54) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_55 Weights: 0 HostPersistent: 1664 DevicePersistent: 115200 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_56, Tanh_57), Mul_58) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_59 Weights: 0 HostPersistent: 512 DevicePersistent: 410112 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_60, Tanh_61), Mul_62), Add_63) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_64 Weights: 0 HostPersistent: 1664 DevicePersistent: 115200 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_39, Tanh_40), Mul_41) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_65, Tanh_66), Mul_67) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_69 Weights: 0 HostPersistent: 3200 DevicePersistent: 164864 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_70, Tanh_71), Mul_72) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_73 Weights: 0 HostPersistent: 1664 DevicePersistent: 1205760 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_74, Tanh_75), Mul_76) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_77 || Conv_81 Weights: 0 HostPersistent: 3200 DevicePersistent: 288256 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_82, Tanh_83), Mul_84) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_85 Weights: 0 HostPersistent: 1664 DevicePersistent: 91136 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_86, Tanh_87), Mul_88) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_89 Weights: 0 HostPersistent: 512 DevicePersistent: 1638912 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_90, Tanh_91), Mul_92), Add_93) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_94 Weights: 0 HostPersistent: 1664 DevicePersistent: 91136 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_95, Tanh_96), Mul_97) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_98 Weights: 0 HostPersistent: 512 DevicePersistent: 1638912 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_99, Tanh_100), Mul_101), Add_102) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_103 Weights: 0 HostPersistent: 1664 DevicePersistent: 91136 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_104, Tanh_105), Mul_106) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_107 Weights: 0 HostPersistent: 512 DevicePersistent: 1638912 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_108, Tanh_109), Mul_110), Add_111) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_112 Weights: 0 HostPersistent: 1664 DevicePersistent: 91136 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_113, Tanh_114), Mul_115) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_116 Weights: 0 HostPersistent: 512 DevicePersistent: 1638912 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_117, Tanh_118), Mul_119), Add_120) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_121 Weights: 0 HostPersistent: 1664 DevicePersistent: 91136 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_122, Tanh_123), Mul_124) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_125 Weights: 0 HostPersistent: 512 DevicePersistent: 1638912 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_126, Tanh_127), Mul_128), Add_129) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_130 Weights: 0 HostPersistent: 1664 DevicePersistent: 91136 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_131, Tanh_132), Mul_133) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_134 Weights: 0 HostPersistent: 512 DevicePersistent: 1638912 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_135, Tanh_136), Mul_137), Add_138) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_139 Weights: 0 HostPersistent: 1664 DevicePersistent: 91136 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_140, Tanh_141), Mul_142) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_143 Weights: 0 HostPersistent: 512 DevicePersistent: 1638912 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_144, Tanh_145), Mul_146), Add_147) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_148 Weights: 0 HostPersistent: 1664 DevicePersistent: 91136 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_149, Tanh_150), Mul_151) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_152 Weights: 0 HostPersistent: 512 DevicePersistent: 1638912 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_153, Tanh_154), Mul_155), Add_156) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_157 Weights: 0 HostPersistent: 1664 DevicePersistent: 91136 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_78, Tanh_79), Mul_80) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_158, Tanh_159), Mul_160) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_162 Weights: 0 HostPersistent: 3200 DevicePersistent: 288256 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_163, Tanh_164), Mul_165) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_166 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_166 Weights: 0 HostPersistent: 1664 DevicePersistent: 4727296 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_483 Weights: 0 HostPersistent: 1664 DevicePersistent: 156672 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_167, Tanh_168), Mul_169) input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_167, Tanh_168), Mul_169) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_170 || Conv_174 Weights: 0 HostPersistent: 3200 DevicePersistent: 1057280 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_175, Tanh_176), Mul_177) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_178 Weights: 0 HostPersistent: 3200 DevicePersistent: 269824 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_179, Tanh_180), Mul_181) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_182 Weights: 0 HostPersistent: 512 DevicePersistent: 6554624 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_183, Tanh_184), Mul_185), Add_186) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_187 Weights: 0 HostPersistent: 3200 DevicePersistent: 269824 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_188, Tanh_189), Mul_190) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_191 Weights: 0 HostPersistent: 512 DevicePersistent: 6554624 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_192, Tanh_193), Mul_194), Add_195) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_196 Weights: 0 HostPersistent: 3200 DevicePersistent: 269824 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_197, Tanh_198), Mul_199) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_200 Weights: 0 HostPersistent: 512 DevicePersistent: 6554624 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_201, Tanh_202), Mul_203), Add_204) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_205 Weights: 0 HostPersistent: 3200 DevicePersistent: 269824 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_206, Tanh_207), Mul_208) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_209 Weights: 0 HostPersistent: 512 DevicePersistent: 6554624 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_210, Tanh_211), Mul_212), Add_213) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_214 Weights: 0 HostPersistent: 3200 DevicePersistent: 269824 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_215, Tanh_216), Mul_217) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_218 Weights: 0 HostPersistent: 512 DevicePersistent: 6554624 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_219, Tanh_220), Mul_221), Add_222) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_223 Weights: 0 HostPersistent: 3200 DevicePersistent: 269824 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_224, Tanh_225), Mul_226) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_227 Weights: 0 HostPersistent: 512 DevicePersistent: 6554624 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_228, Tanh_229), Mul_230), Add_231) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_232 Weights: 0 HostPersistent: 3200 DevicePersistent: 269824 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_233, Tanh_234), Mul_235) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_236 Weights: 0 HostPersistent: 512 DevicePersistent: 6554624 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_237, Tanh_238), Mul_239), Add_240) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_241 Weights: 0 HostPersistent: 3200 DevicePersistent: 269824 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_242, Tanh_243), Mul_244) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_245 Weights: 0 HostPersistent: 512 DevicePersistent: 6554624 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_246, Tanh_247), Mul_248), Add_249) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_250 Weights: 0 HostPersistent: 3200 DevicePersistent: 269824 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_171, Tanh_172), Mul_173) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_251, Tanh_252), Mul_253) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_255 Weights: 0 HostPersistent: 3200 DevicePersistent: 1057280 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_256, Tanh_257), Mul_258) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_259 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_259 Weights: 0 HostPersistent: 1664 DevicePersistent: 18880512 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_401 Weights: 0 HostPersistent: 3200 DevicePersistent: 531968 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_260, Tanh_261), Mul_262) input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_260, Tanh_261), Mul_262) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_263 || Conv_267 Weights: 0 HostPersistent: 3200 DevicePersistent: 4200448 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_268, Tanh_269), Mul_270) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_271 Weights: 0 HostPersistent: 3200 DevicePersistent: 1052672 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_272, Tanh_273), Mul_274) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_275 Weights: 0 HostPersistent: 512 DevicePersistent: 26216448 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_276, Tanh_277), Mul_278), Add_279) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_280 Weights: 0 HostPersistent: 3200 DevicePersistent: 1052672 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_281, Tanh_282), Mul_283) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_284 Weights: 0 HostPersistent: 512 DevicePersistent: 26216448 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_285, Tanh_286), Mul_287), Add_288) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_289 Weights: 0 HostPersistent: 3200 DevicePersistent: 1052672 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_290, Tanh_291), Mul_292) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_293 Weights: 0 HostPersistent: 512 DevicePersistent: 26216448 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_294, Tanh_295), Mul_296), Add_297) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_298 Weights: 0 HostPersistent: 3200 DevicePersistent: 1052672 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_299, Tanh_300), Mul_301) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_302 Weights: 0 HostPersistent: 512 DevicePersistent: 26216448 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(PWN(Softplus_303, Tanh_304), Mul_305), Add_306) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_307 Weights: 0 HostPersistent: 3200 DevicePersistent: 1052672 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_264, Tanh_265), Mul_266) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_308, Tanh_309), Mul_310) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_312 Weights: 0 HostPersistent: 3200 DevicePersistent: 4200448 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(Softplus_313, Tanh_314), Mul_315) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_316 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_316 Weights: 0 HostPersistent: 3200 DevicePersistent: 2101248 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_317 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_317 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_318 Weights: 0 HostPersistent: 512 DevicePersistent: 52432896 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_319 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_320 Weights: 0 HostPersistent: 3200 DevicePersistent: 2101248 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_321 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: MaxPool_322 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: MaxPool_322 output reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: MaxPool_323 Weights: 0 HostPersistent: 16 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: MaxPool_323 output reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: MaxPool_324 Weights: 0 HostPersistent: 16 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: MaxPool_324 output reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1045 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_326 Weights: 0 HostPersistent: 3200 DevicePersistent: 4198400 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_327 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_327 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_328 Weights: 0 HostPersistent: 512 DevicePersistent: 52432896 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_329 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_330 Weights: 0 HostPersistent: 3200 DevicePersistent: 2101248 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_331 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_332 Weights: 524288 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_402 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_333 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Expand_378 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Reshape_400 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_404 Weights: 0 HostPersistent: 3200 DevicePersistent: 531968 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_405 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_406 Weights: 0 HostPersistent: 512 DevicePersistent: 13109248 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_407 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_408 Weights: 0 HostPersistent: 3200 DevicePersistent: 531968 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_409 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_410 Weights: 0 HostPersistent: 512 DevicePersistent: 13109248 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_411 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_412 Weights: 0 HostPersistent: 3200 DevicePersistent: 531968 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_413 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_414 Weights: 0 HostPersistent: 3200 DevicePersistent: 138240 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_484 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_415 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Expand_460 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Reshape_482 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_486 Weights: 0 HostPersistent: 1664 DevicePersistent: 156672 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_487 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_488 Weights: 0 HostPersistent: 512 DevicePersistent: 3277824 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_489 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_490 Weights: 0 HostPersistent: 1664 DevicePersistent: 156672 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_491 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_492 Weights: 0 HostPersistent: 512 DevicePersistent: 3277824 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_493 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_494 Weights: 0 HostPersistent: 1664 DevicePersistent: 156672 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_495 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_496 Weights: 0 HostPersistent: 512 DevicePersistent: 3277824 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_844 Weights: 0 HostPersistent: 1664 DevicePersistent: 1187328 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_497 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_845 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_498 Weights: 0 HostPersistent: 1664 DevicePersistent: 287232 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_847 Weights: 0 HostPersistent: 3200 DevicePersistent: 531968 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_503 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_508 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_513 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_518 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_523 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_528 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_533 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_538 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_543 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_548 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_553 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_558 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Exp_615 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Reshape_592 + Transpose_593 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_636 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_643 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_664 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_671 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_692 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_699 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Sigmoid_616 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(Sigmoid_617, Mul_843) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_848 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1401 + (Unnamed Layer* 615) [Shuffle] + Mul_638 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1408 + (Unnamed Layer* 619) [Shuffle] + Mul_645 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1429 + (Unnamed Layer* 629) [Shuffle] + Mul_666 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1436 + (Unnamed Layer* 633) [Shuffle] + Mul_673 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1457 + (Unnamed Layer* 643) [Shuffle] + Mul_694 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1464 + (Unnamed Layer* 647) [Shuffle] + Mul_701 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_849 Weights: 0 HostPersistent: 512 DevicePersistent: 13109248 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_850 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(1377 + (Unnamed Layer* 602) [Shuffle], PWN(PWN(Sigmoid_610, 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612), Sub_614)) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_851 Weights: 0 HostPersistent: 3200 DevicePersistent: 531968 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_622 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_629 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_650 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_657 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_678 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_685 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_852 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1387 + Add_624 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1394 + Add_631 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1415 + Add_652 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1422 + Add_659 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1443 + Add_680 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1450 + Add_687 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_853 Weights: 0 HostPersistent: 512 DevicePersistent: 13109248 [06/13/2021-16:49:48] [V] [TRT] Layer: 1466 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1468 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1467 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1469 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Div_712 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Div_717 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_722 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_764 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_743 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_785 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_854 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_855 Weights: 0 HostPersistent: 3200 DevicePersistent: 531968 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(1574 + (Unnamed Layer* 740) [Shuffle], Mul_803), Sub_804) Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(1577 + (Unnamed Layer* 744) [Shuffle], Mul_806), Sub_807) Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Add_808 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Add_809 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1576 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1579 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1580 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1581 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_856 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_857 Weights: 0 HostPersistent: 512 DevicePersistent: 13109248 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_1205 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_1205 Weights: 0 HostPersistent: 1664 DevicePersistent: 4722688 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_858 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_1206 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2012 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1058 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_859 Weights: 0 HostPersistent: 3200 DevicePersistent: 529920 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_1208 Weights: 0 HostPersistent: 3200 DevicePersistent: 2101248 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_864 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_869 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_874 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_879 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_884 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_889 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_894 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_899 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_904 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_909 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_914 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_919 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1649 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1669 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1689 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1654 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1674 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1694 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1659 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1679 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1699 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1664 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1684 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1704 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Exp_976 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Reshape_953 + Transpose_954 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_997 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1004 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1025 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1032 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1053 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1060 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Sigmoid_977 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(Sigmoid_978, Mul_1204) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_1209 input reformatter 0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_1209 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1789 + (Unnamed Layer* 886) [Shuffle] + Mul_999 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1796 + (Unnamed Layer* 890) [Shuffle] + Mul_1006 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1817 + (Unnamed Layer* 900) [Shuffle] + Mul_1027 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1824 + (Unnamed Layer* 904) [Shuffle] + Mul_1034 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1845 + (Unnamed Layer* 914) [Shuffle] + Mul_1055 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1852 + (Unnamed Layer* 918) [Shuffle] + Mul_1062 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_1210 Weights: 0 HostPersistent: 512 DevicePersistent: 52432896 [06/13/2021-16:49:48] [V] [TRT] Layer: 1790 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1818 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1846 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1797 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1825 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1853 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_1211 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(1765 + (Unnamed Layer* 873) [Shuffle], PWN(PWN(Sigmoid_971, 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973), Sub_975)) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_1212 Weights: 0 HostPersistent: 3200 DevicePersistent: 2101248 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_983 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_990 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1011 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1018 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1039 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1046 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_1213 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1775 + Add_985 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1782 + Add_992 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1803 + Add_1013 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1810 + Add_1020 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1831 + Add_1041 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1838 + Add_1048 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_1214 Weights: 0 HostPersistent: 512 DevicePersistent: 52432896 [06/13/2021-16:49:48] [V] [TRT] Layer: 1776 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1804 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1832 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1783 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1811 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1839 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1854 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1856 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1855 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1857 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Div_1073 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Div_1078 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1083 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1125 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1104 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1146 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_1215 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_1216 Weights: 0 HostPersistent: 3200 DevicePersistent: 2101248 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(1962 + (Unnamed Layer* 1011) [Shuffle], Mul_1164), Sub_1165) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(1965 + (Unnamed Layer* 1015) [Shuffle], Mul_1167), Sub_1168) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Add_1169 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Add_1170 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1964 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1967 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1968 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1969 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_1217 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_1218 Weights: 0 HostPersistent: 512 DevicePersistent: 52432896 [06/13/2021-16:49:48] [V] [TRT] Layer: LeakyRelu_1219 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Conv_1220 Weights: 1044480 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1225 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1230 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1235 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1240 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1245 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1250 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1255 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1260 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1265 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1270 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1275 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1280 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2037 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2057 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2077 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2042 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2062 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2082 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2047 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2067 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2087 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2052 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2072 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2092 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Exp_1337 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Reshape_1314 + Transpose_1315 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1358 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1365 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1386 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1393 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1414 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1421 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Sigmoid_1338 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(Sigmoid_1339, Mul_1565) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1621 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2009 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2397 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2177 + (Unnamed Layer* 1157) [Shuffle] + Mul_1360 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2184 + (Unnamed Layer* 1161) [Shuffle] + Mul_1367 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2205 + (Unnamed Layer* 1171) [Shuffle] + Mul_1388 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2212 + (Unnamed Layer* 1175) [Shuffle] + Mul_1395 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2233 + (Unnamed Layer* 1185) [Shuffle] + Mul_1416 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2240 + (Unnamed Layer* 1189) [Shuffle] + Mul_1423 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2178 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2206 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2234 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2185 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2213 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2241 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(2153 + (Unnamed Layer* 1144) [Shuffle], PWN(PWN(Sigmoid_1332, 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334), Sub_1336)) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1344 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1351 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1372 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1379 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1400 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1407 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2163 + Add_1346 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2170 + Add_1353 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2191 + Add_1374 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2198 + Add_1381 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2219 + Add_1402 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2226 + Add_1409 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2164 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2192 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2220 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2171 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2199 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2227 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2242 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2244 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2243 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2245 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Div_1434 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Div_1439 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1444 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1486 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1465 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Slice_1507 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(2350 + (Unnamed Layer* 1282) [Shuffle], Mul_1525), Sub_1526) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: PWN(PWN(2353 + (Unnamed Layer* 1286) [Shuffle], Mul_1528), Sub_1529) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Add_1530 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: Add_1531 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2352 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2355 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2356 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2357 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1602 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 1990 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Layer: 2378 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [06/13/2021-16:49:48] [V] [TRT] Total Host Persistent Memory: 226288 [06/13/2021-16:49:48] [V] [TRT] Total Device Persistent Memory: 586202624 [06/13/2021-16:49:48] [V] [TRT] Total Weight Memory: 1568768 [06/13/2021-16:49:48] [V] [TRT] Engine generation completed in 50.8369 seconds. [06/13/2021-16:49:48] [V] [TRT] Builder timing cache: created 508 entries, 1780 hit(s) [06/13/2021-16:49:48] [V] [TRT] Engine Layer Information: [06/13/2021-16:49:48] [V] [TRT] Layer(Constant): 2255[Constant], Tactic: 0, -> [06/13/2021-16:49:48] [V] [TRT] Layer(Constant): 1867[Constant], Tactic: 0, -> [06/13/2021-16:49:48] [V] [TRT] Layer(Constant): 1479[Constant], Tactic: 0, -> [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_0, Tactic: -3456450830548107839, input[Float(3,512,512)] -> 2400[Float(32,512,512)] [06/13/2021-16:49:48] [V] [TRT] Layer(Cast): Cast_1438, Tactic: 0, -> [06/13/2021-16:49:48] [V] [TRT] Layer(Cast): Cast_1433, Tactic: 0, -> [06/13/2021-16:49:48] [V] [TRT] Layer(Cast): Cast_1077, Tactic: 0, -> [06/13/2021-16:49:48] [V] [TRT] Layer(Cast): Cast_1072, Tactic: 0, -> [06/13/2021-16:49:48] [V] [TRT] Layer(Cast): Cast_716, Tactic: 0, -> [06/13/2021-16:49:48] [V] [TRT] Layer(Cast): Cast_711, Tactic: 0, -> [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_1, Tanh_2), Mul_3), Tactic: 3, 2400[Float(32,512,512)] -> 653[Float(32,512,512)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_4, Tactic: 5137655947464784826, 653[Float(32,512,512)] -> 2403[Float(64,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_5, Tanh_6), Mul_7), Tactic: 3, 2403[Float(64,256,256)] -> 658[Float(64,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_8 || Conv_12, Tactic: 5326823351883942011, 658[Float(64,256,256)] -> Conv_8 || Conv_12[Float(128,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_13, Tanh_14), Mul_15), Tactic: 7, Conv_8 || Conv_12[Float(64,256,256)] -> 668[Float(64,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_16, Tactic: 1698681053543049347, 668[Float(64,256,256)] -> 2412[Float(32,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_17, Tanh_18), Mul_19), Tactic: 8, 2412[Float(32,256,256)] -> 673[Float(32,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_20, Tactic: -1343271414618805657, 673[Float(32,256,256)] -> 2415[Float(64,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_21, Tanh_22), Mul_23), Add_24), Tactic: 3, 2415[Float(64,256,256)], 668[Float(64,256,256)] -> 679[Float(64,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_25, Tactic: 5137655947464784826, 679[Float(64,256,256)] -> 2418[Float(64,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_9, Tanh_10), Mul_11), Tactic: 3, Conv_8 || Conv_12[Float(64,256,256)] -> 685[Float(64,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_26, Tanh_27), Mul_28), Tactic: 4, 2418[Float(64,256,256)] -> 685[Float(64,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_30, Tactic: 5137655947464784826, 685[Float(128,256,256)] -> 2421[Float(64,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_31, Tanh_32), Mul_33), Tactic: 3, 2421[Float(64,256,256)] -> 690[Float(64,256,256)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_34, Tactic: -410470605513481746, 690[Float(64,256,256)] -> 2424[Float(128,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_35, Tanh_36), Mul_37), Tactic: 4, 2424[Float(128,128,128)] -> 695[Float(128,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_38 || Conv_42, Tactic: 5326823351883942011, 695[Float(128,128,128)] -> Conv_38 || Conv_42[Float(128,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_43, Tanh_44), Mul_45), Tactic: 5, Conv_38 || Conv_42[Float(64,128,128)] -> 705[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_46, Tactic: 5137655947464784826, 705[Float(64,128,128)] -> 2433[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_47, Tanh_48), Mul_49), Tactic: 5, 2433[Float(64,128,128)] -> 710[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_50, Tactic: 3827454225649558724, 710[Float(64,128,128)] -> 2436[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_51, Tanh_52), Mul_53), Add_54), Tactic: 0, 2436[Float(64,128,128)], 705[Float(64,128,128)] -> 716[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_55, Tactic: 5137655947464784826, 716[Float(64,128,128)] -> 2439[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_56, Tanh_57), Mul_58), Tactic: 5, 2439[Float(64,128,128)] -> 721[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_59, Tactic: 3827454225649558724, 721[Float(64,128,128)] -> 2442[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_60, Tanh_61), Mul_62), Add_63), Tactic: 0, 2442[Float(64,128,128)], 716[Float(64,128,128)] -> 727[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_64, Tactic: 5137655947464784826, 727[Float(64,128,128)] -> 2445[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_39, Tanh_40), Mul_41), Tactic: 4, Conv_38 || Conv_42[Float(64,128,128)] -> 733[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_65, Tanh_66), Mul_67), Tactic: 4, 2445[Float(64,128,128)] -> 733[Float(64,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_69, Tactic: 5326823351883942011, 733[Float(128,128,128)] -> 2448[Float(128,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_70, Tanh_71), Mul_72), Tactic: 4, 2448[Float(128,128,128)] -> 738[Float(128,128,128)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_73, Tactic: 5137655947464784826, 738[Float(128,128,128)] -> 2451[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_74, Tanh_75), Mul_76), Tactic: 4, 2451[Float(256,64,64)] -> 743[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_77 || Conv_81, Tactic: -37215280111360163, 743[Float(256,64,64)] -> Conv_77 || Conv_81[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_82, Tanh_83), Mul_84), Tactic: 5, Conv_77 || Conv_81[Float(128,64,64)] -> 753[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_85, Tactic: 5137655947464784826, 753[Float(128,64,64)] -> 2460[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_86, Tanh_87), Mul_88), Tactic: 1, 2460[Float(128,64,64)] -> 758[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_89, Tactic: 3827454225649558724, 758[Float(128,64,64)] -> 2463[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_90, Tanh_91), Mul_92), Add_93), Tactic: 4, 2463[Float(128,64,64)], 753[Float(128,64,64)] -> 764[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_94, Tactic: 5137655947464784826, 764[Float(128,64,64)] -> 2466[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_95, Tanh_96), Mul_97), Tactic: 1, 2466[Float(128,64,64)] -> 769[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_98, Tactic: 3827454225649558724, 769[Float(128,64,64)] -> 2469[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_99, Tanh_100), Mul_101), Add_102), Tactic: 4, 2469[Float(128,64,64)], 764[Float(128,64,64)] -> 775[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_103, Tactic: 5137655947464784826, 775[Float(128,64,64)] -> 2472[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_104, Tanh_105), Mul_106), Tactic: 1, 2472[Float(128,64,64)] -> 780[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_107, Tactic: 3827454225649558724, 780[Float(128,64,64)] -> 2475[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_108, Tanh_109), Mul_110), Add_111), Tactic: 4, 2475[Float(128,64,64)], 775[Float(128,64,64)] -> 786[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_112, Tactic: 5137655947464784826, 786[Float(128,64,64)] -> 2478[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_113, Tanh_114), Mul_115), Tactic: 1, 2478[Float(128,64,64)] -> 791[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_116, Tactic: 3827454225649558724, 791[Float(128,64,64)] -> 2481[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_117, Tanh_118), Mul_119), Add_120), Tactic: 4, 2481[Float(128,64,64)], 786[Float(128,64,64)] -> 797[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_121, Tactic: 5137655947464784826, 797[Float(128,64,64)] -> 2484[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_122, Tanh_123), Mul_124), Tactic: 1, 2484[Float(128,64,64)] -> 802[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_125, Tactic: 3827454225649558724, 802[Float(128,64,64)] -> 2487[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_126, Tanh_127), Mul_128), Add_129), Tactic: 4, 2487[Float(128,64,64)], 797[Float(128,64,64)] -> 808[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_130, Tactic: 5137655947464784826, 808[Float(128,64,64)] -> 2490[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_131, Tanh_132), Mul_133), Tactic: 1, 2490[Float(128,64,64)] -> 813[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_134, Tactic: 3827454225649558724, 813[Float(128,64,64)] -> 2493[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_135, Tanh_136), Mul_137), Add_138), Tactic: 4, 2493[Float(128,64,64)], 808[Float(128,64,64)] -> 819[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_139, Tactic: 5137655947464784826, 819[Float(128,64,64)] -> 2496[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_140, Tanh_141), Mul_142), Tactic: 1, 2496[Float(128,64,64)] -> 824[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_143, Tactic: 3827454225649558724, 824[Float(128,64,64)] -> 2499[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_144, Tanh_145), Mul_146), Add_147), Tactic: 4, 2499[Float(128,64,64)], 819[Float(128,64,64)] -> 830[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_148, Tactic: 5137655947464784826, 830[Float(128,64,64)] -> 2502[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_149, Tanh_150), Mul_151), Tactic: 1, 2502[Float(128,64,64)] -> 835[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_152, Tactic: 3827454225649558724, 835[Float(128,64,64)] -> 2505[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_153, Tanh_154), Mul_155), Add_156), Tactic: 4, 2505[Float(128,64,64)], 830[Float(128,64,64)] -> 841[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_157, Tactic: 5137655947464784826, 841[Float(128,64,64)] -> 2508[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_78, Tanh_79), Mul_80), Tactic: 9, Conv_77 || Conv_81[Float(128,64,64)] -> 847[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_158, Tanh_159), Mul_160), Tactic: 2, 2508[Float(128,64,64)] -> 847[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_162, Tactic: -37215280111360163, 847[Float(256,64,64)] -> 2511[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_163, Tanh_164), Mul_165), Tactic: 4, 2511[Float(256,64,64)] -> 852[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Conv_166 input reformatter 0, Tactic: 1002, 852[Float(256,64,64)] -> Conv_166 reformatted input 0[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_166, Tactic: -9153228964338181824, Conv_166 reformatted input 0[Float(256,64,64)] -> 2514[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_483, Tactic: 5137655947464784826, 852[Float(256,64,64)] -> 2658[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): PWN(PWN(Softplus_167, Tanh_168), Mul_169) input reformatter 0, Tactic: 1002, 2514[Float(512,32,32)] -> PWN(PWN(Softplus_167, Tanh_168), Mul_169) reformatted input 0[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_167, Tanh_168), Mul_169), Tactic: 5, PWN(PWN(Softplus_167, Tanh_168), Mul_169) reformatted input 0[Float(512,32,32)] -> 857[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_170 || Conv_174, Tactic: -37215280111360163, 857[Float(512,32,32)] -> Conv_170 || Conv_174[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_175, Tanh_176), Mul_177), Tactic: 8, Conv_170 || Conv_174[Float(256,32,32)] -> 867[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_178, Tactic: 1698681053543049347, 867[Float(256,32,32)] -> 2523[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_179, Tanh_180), Mul_181), Tactic: 5, 2523[Float(256,32,32)] -> 872[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_182, Tactic: -8776506421218919509, 872[Float(256,32,32)] -> 2526[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_183, Tanh_184), Mul_185), Add_186), Tactic: 0, 2526[Float(256,32,32)], 867[Float(256,32,32)] -> 878[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_187, Tactic: 1698681053543049347, 878[Float(256,32,32)] -> 2529[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_188, Tanh_189), Mul_190), Tactic: 5, 2529[Float(256,32,32)] -> 883[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_191, Tactic: -8776506421218919509, 883[Float(256,32,32)] -> 2532[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_192, Tanh_193), Mul_194), Add_195), Tactic: 0, 2532[Float(256,32,32)], 878[Float(256,32,32)] -> 889[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_196, Tactic: 1698681053543049347, 889[Float(256,32,32)] -> 2535[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_197, Tanh_198), Mul_199), Tactic: 5, 2535[Float(256,32,32)] -> 894[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_200, Tactic: -8776506421218919509, 894[Float(256,32,32)] -> 2538[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_201, Tanh_202), Mul_203), Add_204), Tactic: 0, 2538[Float(256,32,32)], 889[Float(256,32,32)] -> 900[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_205, Tactic: 1698681053543049347, 900[Float(256,32,32)] -> 2541[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_206, Tanh_207), Mul_208), Tactic: 5, 2541[Float(256,32,32)] -> 905[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_209, Tactic: -8776506421218919509, 905[Float(256,32,32)] -> 2544[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_210, Tanh_211), Mul_212), Add_213), Tactic: 0, 2544[Float(256,32,32)], 900[Float(256,32,32)] -> 911[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_214, Tactic: 1698681053543049347, 911[Float(256,32,32)] -> 2547[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_215, Tanh_216), Mul_217), Tactic: 5, 2547[Float(256,32,32)] -> 916[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_218, Tactic: -8776506421218919509, 916[Float(256,32,32)] -> 2550[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_219, Tanh_220), Mul_221), Add_222), Tactic: 0, 2550[Float(256,32,32)], 911[Float(256,32,32)] -> 922[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_223, Tactic: 1698681053543049347, 922[Float(256,32,32)] -> 2553[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_224, Tanh_225), Mul_226), Tactic: 5, 2553[Float(256,32,32)] -> 927[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_227, Tactic: -8776506421218919509, 927[Float(256,32,32)] -> 2556[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_228, Tanh_229), Mul_230), Add_231), Tactic: 0, 2556[Float(256,32,32)], 922[Float(256,32,32)] -> 933[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_232, Tactic: 1698681053543049347, 933[Float(256,32,32)] -> 2559[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_233, Tanh_234), Mul_235), Tactic: 5, 2559[Float(256,32,32)] -> 938[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_236, Tactic: -8776506421218919509, 938[Float(256,32,32)] -> 2562[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_237, Tanh_238), Mul_239), Add_240), Tactic: 0, 2562[Float(256,32,32)], 933[Float(256,32,32)] -> 944[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_241, Tactic: 1698681053543049347, 944[Float(256,32,32)] -> 2565[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_242, Tanh_243), Mul_244), Tactic: 5, 2565[Float(256,32,32)] -> 949[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_245, Tactic: -8776506421218919509, 949[Float(256,32,32)] -> 2568[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_246, Tanh_247), Mul_248), Add_249), Tactic: 0, 2568[Float(256,32,32)], 944[Float(256,32,32)] -> 955[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_250, Tactic: 1698681053543049347, 955[Float(256,32,32)] -> 2571[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_171, Tanh_172), Mul_173), Tactic: 5, Conv_170 || Conv_174[Float(256,32,32)] -> 961[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_251, Tanh_252), Mul_253), Tactic: 9, 2571[Float(256,32,32)] -> 961[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_255, Tactic: -37215280111360163, 961[Float(512,32,32)] -> 2574[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_256, Tanh_257), Mul_258), Tactic: 5, 2574[Float(512,32,32)] -> 966[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Conv_259 input reformatter 0, Tactic: 1002, 966[Float(512,32,32)] -> Conv_259 reformatted input 0[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_259, Tactic: -9153228964338181824, Conv_259 reformatted input 0[Float(512,32,32)] -> 2577[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_401, Tactic: 1698681053543049347, 966[Float(512,32,32)] -> 2637[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): PWN(PWN(Softplus_260, Tanh_261), Mul_262) input reformatter 0, Tactic: 1002, 2577[Float(1024,16,16)] -> PWN(PWN(Softplus_260, Tanh_261), Mul_262) reformatted input 0[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_260, Tanh_261), Mul_262), Tactic: 8, PWN(PWN(Softplus_260, Tanh_261), Mul_262) reformatted input 0[Float(1024,16,16)] -> 971[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_263 || Conv_267, Tactic: -37215280111360163, 971[Float(1024,16,16)] -> Conv_263 || Conv_267[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_268, Tanh_269), Mul_270), Tactic: 8, Conv_263 || Conv_267[Float(512,16,16)] -> 981[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_271, Tactic: -37215280111360163, 981[Float(512,16,16)] -> 2586[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_272, Tanh_273), Mul_274), Tactic: 7, 2586[Float(512,16,16)] -> 986[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_275, Tactic: -8776506421218919509, 986[Float(512,16,16)] -> 2589[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_276, Tanh_277), Mul_278), Add_279), Tactic: 8, 2589[Float(512,16,16)], 981[Float(512,16,16)] -> 992[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_280, Tactic: -37215280111360163, 992[Float(512,16,16)] -> 2592[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_281, Tanh_282), Mul_283), Tactic: 7, 2592[Float(512,16,16)] -> 997[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_284, Tactic: -8776506421218919509, 997[Float(512,16,16)] -> 2595[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_285, Tanh_286), Mul_287), Add_288), Tactic: 8, 2595[Float(512,16,16)], 992[Float(512,16,16)] -> 1003[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_289, Tactic: -37215280111360163, 1003[Float(512,16,16)] -> 2598[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_290, Tanh_291), Mul_292), Tactic: 7, 2598[Float(512,16,16)] -> 1008[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_293, Tactic: -8776506421218919509, 1008[Float(512,16,16)] -> 2601[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_294, Tanh_295), Mul_296), Add_297), Tactic: 8, 2601[Float(512,16,16)], 1003[Float(512,16,16)] -> 1014[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_298, Tactic: -37215280111360163, 1014[Float(512,16,16)] -> 2604[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_299, Tanh_300), Mul_301), Tactic: 7, 2604[Float(512,16,16)] -> 1019[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_302, Tactic: -8776506421218919509, 1019[Float(512,16,16)] -> 2607[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(PWN(Softplus_303, Tanh_304), Mul_305), Add_306), Tactic: 8, 2607[Float(512,16,16)], 1014[Float(512,16,16)] -> 1025[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_307, Tactic: -37215280111360163, 1025[Float(512,16,16)] -> 2610[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_264, Tanh_265), Mul_266), Tactic: 5, Conv_263 || Conv_267[Float(512,16,16)] -> 1031[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_308, Tanh_309), Mul_310), Tactic: 5, 2610[Float(512,16,16)] -> 1031[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_312, Tactic: -37215280111360163, 1031[Float(1024,16,16)] -> 2613[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(Softplus_313, Tanh_314), Mul_315), Tactic: 8, 2613[Float(1024,16,16)] -> 1036[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Conv_316 input reformatter 0, Tactic: 1002, 1036[Float(1024,16,16)] -> Conv_316 reformatted input 0[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_316, Tactic: 6629944304117643200, Conv_316 reformatted input 0[Float(1024,16,16)] -> 2616[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): LeakyRelu_317 input reformatter 0, Tactic: 1002, 2616[Float(512,16,16)] -> LeakyRelu_317 reformatted input 0[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_317, Tactic: 5, LeakyRelu_317 reformatted input 0[Float(512,16,16)] -> 1039[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_318, Tactic: -1343271414618805657, 1039[Float(512,16,16)] -> 2619[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_319, Tactic: 4, 2619[Float(1024,16,16)] -> 1042[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_320, Tactic: -37215280111360163, 1042[Float(1024,16,16)] -> 2622[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_321, Tactic: 5, 2622[Float(512,16,16)] -> 1045[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PoolingTiled): MaxPool_322, Tactic: 7735312, 1045[Float(512,16,16)] -> MaxPool_322 output to be reformatted 0[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): MaxPool_322 output reformatter 0, Tactic: 1002, MaxPool_322 output to be reformatted 0[Float(512,16,16)] -> 1049[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Pooling): MaxPool_323, Tactic: -1, 1045[Float(512,16,16)] -> MaxPool_323 output to be reformatted 0[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): MaxPool_323 output reformatter 0, Tactic: 1002, MaxPool_323 output to be reformatted 0[Float(512,16,16)] -> 1049[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Pooling): MaxPool_324, Tactic: -1, 1045[Float(512,16,16)] -> MaxPool_324 output to be reformatted 0[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): MaxPool_324 output reformatter 0, Tactic: 1002, MaxPool_324 output to be reformatted 0[Float(512,16,16)] -> 1049[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1045 copy, Tactic: 1002, 1045[Float(512,16,16)] -> 1049[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_326, Tactic: 6629944304117643200, 1049[Float(2048,16,16)] -> 2625[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): LeakyRelu_327 input reformatter 0, Tactic: 1002, 2625[Float(512,16,16)] -> LeakyRelu_327 reformatted input 0[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_327, Tactic: 5, LeakyRelu_327 reformatted input 0[Float(512,16,16)] -> 1052[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_328, Tactic: -1343271414618805657, 1052[Float(512,16,16)] -> 2628[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_329, Tactic: 4, 2628[Float(1024,16,16)] -> 1055[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_330, Tactic: -37215280111360163, 1055[Float(1024,16,16)] -> 2631[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_331, Tactic: 5, 2631[Float(512,16,16)] -> 1058[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(FusedConvActDirect): Conv_332, Tactic: 1179647, 1058[Float(512,16,16)] -> 2634[Float(256,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_402, Tactic: 9, 2637[Float(256,32,32)] -> 1140[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_333, Tactic: 3, 2634[Float(256,16,16)] -> 1061[Float(256,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Slice): Expand_378, Tactic: 0, 1083[Float(256,16,1,16,1)] -> 1114[Float(256,16,2,16,2)] [06/13/2021-16:49:48] [V] [TRT] Layer(Shuffle): Reshape_400, Tactic: 0, 1114[Float(256,16,2,16,2)] -> 1140[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_404, Tactic: 1698681053543049347, 1140[Float(512,32,32)] -> 2640[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_405, Tactic: 4, 2640[Float(256,32,32)] -> 1143[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_406, Tactic: -8776506421218919509, 1143[Float(256,32,32)] -> 2643[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_407, Tactic: 8, 2643[Float(512,32,32)] -> 1146[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_408, Tactic: 1698681053543049347, 1146[Float(512,32,32)] -> 2646[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_409, Tactic: 4, 2646[Float(256,32,32)] -> 1149[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_410, Tactic: -8776506421218919509, 1149[Float(256,32,32)] -> 2649[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_411, Tactic: 8, 2649[Float(512,32,32)] -> 1152[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_412, Tactic: 1698681053543049347, 1152[Float(512,32,32)] -> 2652[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_413, Tactic: 9, 2652[Float(256,32,32)] -> 1625[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_414, Tactic: 1698681053543049347, 1625[Float(256,32,32)] -> 2655[Float(128,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_484, Tactic: 9, 2658[Float(128,64,64)] -> 1237[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_415, Tactic: 8, 2655[Float(128,32,32)] -> 1158[Float(128,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Slice): Expand_460, Tactic: 0, 1180[Float(128,32,1,32,1)] -> 1211[Float(128,32,2,32,2)] [06/13/2021-16:49:48] [V] [TRT] Layer(Shuffle): Reshape_482, Tactic: 0, 1211[Float(128,32,2,32,2)] -> 1237[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_486, Tactic: 5137655947464784826, 1237[Float(256,64,64)] -> 2661[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_487, Tactic: 2, 2661[Float(128,64,64)] -> 1240[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_488, Tactic: 3827454225649558724, 1240[Float(128,64,64)] -> 2664[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_489, Tactic: 1, 2664[Float(256,64,64)] -> 1243[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_490, Tactic: 5137655947464784826, 1243[Float(256,64,64)] -> 2667[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_491, Tactic: 2, 2667[Float(128,64,64)] -> 1246[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_492, Tactic: 3827454225649558724, 1246[Float(128,64,64)] -> 2670[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_493, Tactic: 1, 2670[Float(256,64,64)] -> 1249[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_494, Tactic: 5137655947464784826, 1249[Float(256,64,64)] -> 2673[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_495, Tactic: 2, 2673[Float(128,64,64)] -> 1252[Float(128,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_496, Tactic: 3827454225649558724, 1252[Float(128,64,64)] -> 2676[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_844, Tactic: 5137655947464784826, 1252[Float(128,64,64)] -> 2679[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_497, Tactic: 1, 2676[Float(256,64,64)] -> 1255[Float(256,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_845, Tactic: 9, 2679[Float(256,32,32)] -> 1625[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_498, Tactic: 5137655947464784826, 1255[Float(256,64,64)] -> 1256[Float(255,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_847, Tactic: 1698681053543049347, 1625[Float(512,32,32)] -> 2682[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_503, Tactic: 0, 1256[Float(2,64,64)] -> 1317[Float(2,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_508, Tactic: 0, 1256[Float(2,64,64)] -> 1318[Float(2,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_513, Tactic: 0, 1256[Float(1,64,64)] -> 1319[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_518, Tactic: 0, 1256[Float(80,64,64)] -> 1336[Float(80,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_523, Tactic: 0, 1256[Float(2,64,64)] -> 1317[Float(2,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_528, Tactic: 0, 1256[Float(2,64,64)] -> 1318[Float(2,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_533, Tactic: 0, 1256[Float(1,64,64)] -> 1319[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_538, Tactic: 0, 1256[Float(80,64,64)] -> 1336[Float(80,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_543, Tactic: 0, 1256[Float(2,64,64)] -> 1317[Float(2,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_548, Tactic: 0, 1256[Float(2,64,64)] -> 1318[Float(2,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_553, Tactic: 0, 1256[Float(1,64,64)] -> 1319[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_558, Tactic: 0, 1256[Float(80,64,64)] -> 1336[Float(80,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Unary): Exp_615, Tactic: 0, 1318[Float(6,64,64)] -> 1379[Float(6,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Shuffle): Reshape_592 + Transpose_593, Tactic: 0, 1336[Float(240,64,64)] -> 1355[Float(3,4096,80)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_636, Tactic: 0, 1379[Float(1,64,64)] -> 1400[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_643, Tactic: 0, 1379[Float(1,64,64)] -> 1407[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_664, Tactic: 0, 1379[Float(1,64,64)] -> 1428[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_671, Tactic: 0, 1379[Float(1,64,64)] -> 1435[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_692, Tactic: 0, 1379[Float(1,64,64)] -> 1456[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_699, Tactic: 0, 1379[Float(1,64,64)] -> 1463[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Activation): Sigmoid_616, Tactic: 0, 1335[Float(12288)] -> 1380[Float(12288)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_617, Mul_843), Tactic: 3, 1373[Float(12288,80)], 1620[Float(12288,1)] -> 1621[Float(12288,80)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_848, Tactic: 4, 2682[Float(256,32,32)] -> 1628[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1401 + (Unnamed Layer* 615) [Shuffle] + Mul_638, Tactic: 0, 1400[Float(1,64,64)] -> 1468[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1408 + (Unnamed Layer* 619) [Shuffle] + Mul_645, Tactic: 0, 1407[Float(1,64,64)] -> 1469[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1429 + (Unnamed Layer* 629) [Shuffle] + Mul_666, Tactic: 0, 1428[Float(1,64,64)] -> 1468[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1436 + (Unnamed Layer* 633) [Shuffle] + Mul_673, Tactic: 0, 1435[Float(1,64,64)] -> 1469[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1457 + (Unnamed Layer* 643) [Shuffle] + Mul_694, Tactic: 0, 1456[Float(1,64,64)] -> 1468[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1464 + (Unnamed Layer* 647) [Shuffle] + Mul_701, Tactic: 0, 1463[Float(1,64,64)] -> 1469[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_849, Tactic: -8776506421218919509, 1628[Float(256,32,32)] -> 2685[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_850, Tactic: 8, 2685[Float(512,32,32)] -> 1631[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(1377 + (Unnamed Layer* 602) [Shuffle], PWN(PWN(Sigmoid_610, 1375 + (Unnamed Layer* 599) [Shuffle] + Mul_612), Sub_614)), Tactic: 0, 1317[Float(6,64,64)] -> 1378[Float(6,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_851, Tactic: 1698681053543049347, 1631[Float(512,32,32)] -> 2688[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_622, Tactic: 0, 1378[Float(1,64,64)] -> 1386[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_629, Tactic: 0, 1378[Float(1,64,64)] -> 1393[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_650, Tactic: 0, 1378[Float(1,64,64)] -> 1414[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_657, Tactic: 0, 1378[Float(1,64,64)] -> 1421[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_678, Tactic: 0, 1378[Float(1,64,64)] -> 1442[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_685, Tactic: 0, 1378[Float(1,64,64)] -> 1449[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_852, Tactic: 4, 2688[Float(256,32,32)] -> 1634[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1387 + Add_624, Tactic: 0, 1386[Float(1,64,64)] -> 1466[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1394 + Add_631, Tactic: 0, 1393[Float(1,64,64)] -> 1467[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1415 + Add_652, Tactic: 0, 1414[Float(1,64,64)] -> 1466[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1422 + Add_659, Tactic: 0, 1421[Float(1,64,64)] -> 1467[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1443 + Add_680, Tactic: 0, 1442[Float(1,64,64)] -> 1466[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1450 + Add_687, Tactic: 0, 1449[Float(1,64,64)] -> 1467[Float(1,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_853, Tactic: -8776506421218919509, 1634[Float(256,32,32)] -> 2691[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1466 copy, Tactic: 0, 1466[Float(3,64,64)] -> 1470[Float(3,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1468 copy, Tactic: 0, 1468[Float(3,64,64)] -> 1470[Float(3,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1467 copy, Tactic: 0, 1467[Float(3,64,64)] -> 1471[Float(3,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1469 copy, Tactic: 0, 1469[Float(3,64,64)] -> 1471[Float(3,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Div_712, Tactic: 1, 1470[Float(6,64,64)], (Unnamed Layer* 659) [Shuffle]_output[Float(1,1,1)] -> 1476[Float(6,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Div_717, Tactic: 1, 1471[Float(6,64,64)], (Unnamed Layer* 665) [Shuffle]_output[Float(1,1,1)] -> 1481[Float(6,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_722, Tactic: 0, 1476[Float(3,64,64)] -> 1486[Float(3,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_764, Tactic: 0, 1476[Float(3,64,64)] -> 1532[Float(3,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_743, Tactic: 0, 1481[Float(3,64,64)] -> 1509[Float(3,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_785, Tactic: 0, 1481[Float(3,64,64)] -> 1555[Float(3,64,64)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_854, Tactic: 8, 2691[Float(512,32,32)] -> 1637[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_855, Tactic: 1698681053543049347, 1637[Float(512,32,32)] -> 2694[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWise): PWN(PWN(1574 + (Unnamed Layer* 740) [Shuffle], Mul_803), Sub_804), Tactic: 128, 1550[Float(12288,1)], 1504[Float(12288,1)] -> 1576[Float(12288,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWise): PWN(PWN(1577 + (Unnamed Layer* 744) [Shuffle], Mul_806), Sub_807), Tactic: 128, 1573[Float(12288,1)], 1527[Float(12288,1)] -> 1579[Float(12288,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Add_808, Tactic: 1, 1576[Float(12288,1)], 1550[Float(12288,1)] -> 1580[Float(12288,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Add_809, Tactic: 1, 1579[Float(12288,1)], 1573[Float(12288,1)] -> 1581[Float(12288,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1576 copy, Tactic: 0, 1576[Float(12288,1)] -> 1582[Float(12288,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1579 copy, Tactic: 0, 1579[Float(12288,1)] -> 1582[Float(12288,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1580 copy, Tactic: 0, 1580[Float(12288,1)] -> 1582[Float(12288,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1581 copy, Tactic: 0, 1581[Float(12288,1)] -> 1582[Float(12288,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_856, Tactic: 4, 2694[Float(256,32,32)] -> 1640[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_857, Tactic: -8776506421218919509, 1640[Float(256,32,32)] -> 2697[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Conv_1205 input reformatter 0, Tactic: 1002, 1640[Float(256,32,32)] -> Conv_1205 reformatted input 0[Float(256,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_1205, Tactic: -9153228964338181824, Conv_1205 reformatted input 0[Float(256,32,32)] -> 2700[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_858, Tactic: 8, 2697[Float(512,32,32)] -> 1643[Float(512,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWise): LeakyRelu_1206, Tactic: 256, 2700[Float(512,16,16)] -> 2012[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2012 copy, Tactic: 1002, 2012[Float(512,16,16)] -> 2013[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1058 copy, Tactic: 1002, 1058[Float(512,16,16)] -> 2013[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_859, Tactic: 1698681053543049347, 1643[Float(512,32,32)] -> 1644[Float(255,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_1208, Tactic: 6629944304117643200, 2013[Float(1024,16,16)] -> 2703[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_864, Tactic: 0, 1644[Float(2,32,32)] -> 1649[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_869, Tactic: 0, 1644[Float(2,32,32)] -> 1654[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_874, Tactic: 0, 1644[Float(1,32,32)] -> 1659[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_879, Tactic: 0, 1644[Float(80,32,32)] -> 1664[Float(80,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_884, Tactic: 0, 1644[Float(2,32,32)] -> 1669[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_889, Tactic: 0, 1644[Float(2,32,32)] -> 1674[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_894, Tactic: 0, 1644[Float(1,32,32)] -> 1679[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_899, Tactic: 0, 1644[Float(80,32,32)] -> 1684[Float(80,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_904, Tactic: 0, 1644[Float(2,32,32)] -> 1689[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_909, Tactic: 0, 1644[Float(2,32,32)] -> 1694[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_914, Tactic: 0, 1644[Float(1,32,32)] -> 1699[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_919, Tactic: 0, 1644[Float(80,32,32)] -> 1704[Float(80,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1649 copy, Tactic: 0, 1649[Float(2,32,32)] -> 1705[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1669 copy, Tactic: 0, 1669[Float(2,32,32)] -> 1705[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1689 copy, Tactic: 0, 1689[Float(2,32,32)] -> 1705[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1654 copy, Tactic: 0, 1654[Float(2,32,32)] -> 1706[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1674 copy, Tactic: 0, 1674[Float(2,32,32)] -> 1706[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1694 copy, Tactic: 0, 1694[Float(2,32,32)] -> 1706[Float(2,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1659 copy, Tactic: 0, 1659[Float(1,32,32)] -> 1707[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1679 copy, Tactic: 0, 1679[Float(1,32,32)] -> 1707[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1699 copy, Tactic: 0, 1699[Float(1,32,32)] -> 1707[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1664 copy, Tactic: 0, 1664[Float(80,32,32)] -> 1724[Float(80,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1684 copy, Tactic: 0, 1684[Float(80,32,32)] -> 1724[Float(80,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1704 copy, Tactic: 0, 1704[Float(80,32,32)] -> 1724[Float(80,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Unary): Exp_976, Tactic: 0, 1706[Float(6,32,32)] -> 1767[Float(6,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Shuffle): Reshape_953 + Transpose_954, Tactic: 0, 1724[Float(240,32,32)] -> 1743[Float(3,1024,80)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_997, Tactic: 0, 1767[Float(1,32,32)] -> 1788[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1004, Tactic: 0, 1767[Float(1,32,32)] -> 1795[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1025, Tactic: 0, 1767[Float(1,32,32)] -> 1816[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1032, Tactic: 0, 1767[Float(1,32,32)] -> 1823[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1053, Tactic: 0, 1767[Float(1,32,32)] -> 1844[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1060, Tactic: 0, 1767[Float(1,32,32)] -> 1851[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Activation): Sigmoid_977, Tactic: 0, 1723[Float(3072)] -> 1768[Float(3072)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_978, Mul_1204), Tactic: 4, 1761[Float(3072,80)], 2008[Float(3072,1)] -> 2009[Float(3072,80)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): LeakyRelu_1209 input reformatter 0, Tactic: 1002, 2703[Float(512,16,16)] -> LeakyRelu_1209 reformatted input 0[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_1209, Tactic: 5, LeakyRelu_1209 reformatted input 0[Float(512,16,16)] -> 2016[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1789 + (Unnamed Layer* 886) [Shuffle] + Mul_999, Tactic: 0, 1788[Float(1,32,32)] -> 1790[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1796 + (Unnamed Layer* 890) [Shuffle] + Mul_1006, Tactic: 0, 1795[Float(1,32,32)] -> 1797[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1817 + (Unnamed Layer* 900) [Shuffle] + Mul_1027, Tactic: 0, 1816[Float(1,32,32)] -> 1818[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1824 + (Unnamed Layer* 904) [Shuffle] + Mul_1034, Tactic: 0, 1823[Float(1,32,32)] -> 1825[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1845 + (Unnamed Layer* 914) [Shuffle] + Mul_1055, Tactic: 0, 1844[Float(1,32,32)] -> 1846[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1852 + (Unnamed Layer* 918) [Shuffle] + Mul_1062, Tactic: 0, 1851[Float(1,32,32)] -> 1853[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_1210, Tactic: -1343271414618805657, 2016[Float(512,16,16)] -> 2706[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1790 copy, Tactic: 0, 1790[Float(1,32,32)] -> 1856[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1818 copy, Tactic: 0, 1818[Float(1,32,32)] -> 1856[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1846 copy, Tactic: 0, 1846[Float(1,32,32)] -> 1856[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1797 copy, Tactic: 0, 1797[Float(1,32,32)] -> 1857[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1825 copy, Tactic: 0, 1825[Float(1,32,32)] -> 1857[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1853 copy, Tactic: 0, 1853[Float(1,32,32)] -> 1857[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_1211, Tactic: 4, 2706[Float(1024,16,16)] -> 2019[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(1765 + (Unnamed Layer* 873) [Shuffle], PWN(PWN(Sigmoid_971, 1763 + (Unnamed Layer* 870) [Shuffle] + Mul_973), Sub_975)), Tactic: 0, 1705[Float(6,32,32)] -> 1766[Float(6,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_1212, Tactic: -37215280111360163, 2019[Float(1024,16,16)] -> 2709[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_983, Tactic: 0, 1766[Float(1,32,32)] -> 1774[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_990, Tactic: 0, 1766[Float(1,32,32)] -> 1781[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1011, Tactic: 0, 1766[Float(1,32,32)] -> 1802[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1018, Tactic: 0, 1766[Float(1,32,32)] -> 1809[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1039, Tactic: 0, 1766[Float(1,32,32)] -> 1830[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1046, Tactic: 0, 1766[Float(1,32,32)] -> 1837[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_1213, Tactic: 5, 2709[Float(512,16,16)] -> 2022[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1775 + Add_985, Tactic: 0, 1774[Float(1,32,32)] -> 1776[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1782 + Add_992, Tactic: 0, 1781[Float(1,32,32)] -> 1783[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1803 + Add_1013, Tactic: 0, 1802[Float(1,32,32)] -> 1804[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1810 + Add_1020, Tactic: 0, 1809[Float(1,32,32)] -> 1811[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1831 + Add_1041, Tactic: 0, 1830[Float(1,32,32)] -> 1832[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 1838 + Add_1048, Tactic: 0, 1837[Float(1,32,32)] -> 1839[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_1214, Tactic: -1343271414618805657, 2022[Float(512,16,16)] -> 2712[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1776 copy, Tactic: 0, 1776[Float(1,32,32)] -> 1854[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1804 copy, Tactic: 0, 1804[Float(1,32,32)] -> 1854[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1832 copy, Tactic: 0, 1832[Float(1,32,32)] -> 1854[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1783 copy, Tactic: 0, 1783[Float(1,32,32)] -> 1855[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1811 copy, Tactic: 0, 1811[Float(1,32,32)] -> 1855[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1839 copy, Tactic: 0, 1839[Float(1,32,32)] -> 1855[Float(1,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1854 copy, Tactic: 0, 1854[Float(3,32,32)] -> 1858[Float(3,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1856 copy, Tactic: 0, 1856[Float(3,32,32)] -> 1858[Float(3,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1855 copy, Tactic: 0, 1855[Float(3,32,32)] -> 1859[Float(3,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1857 copy, Tactic: 0, 1857[Float(3,32,32)] -> 1859[Float(3,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Div_1073, Tactic: 1, 1858[Float(6,32,32)], (Unnamed Layer* 930) [Shuffle]_output[Float(1,1,1)] -> 1864[Float(6,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Div_1078, Tactic: 1, 1859[Float(6,32,32)], (Unnamed Layer* 936) [Shuffle]_output[Float(1,1,1)] -> 1869[Float(6,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1083, Tactic: 0, 1864[Float(3,32,32)] -> 1874[Float(3,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1125, Tactic: 0, 1864[Float(3,32,32)] -> 1920[Float(3,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1104, Tactic: 0, 1869[Float(3,32,32)] -> 1897[Float(3,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1146, Tactic: 0, 1869[Float(3,32,32)] -> 1943[Float(3,32,32)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_1215, Tactic: 4, 2712[Float(1024,16,16)] -> 2025[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn): Conv_1216, Tactic: -37215280111360163, 2025[Float(1024,16,16)] -> 2715[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(1962 + (Unnamed Layer* 1011) [Shuffle], Mul_1164), Sub_1165), Tactic: 0, 1938[Float(3072,1)], 1892[Float(3072,1)] -> 1964[Float(3072,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(1965 + (Unnamed Layer* 1015) [Shuffle], Mul_1167), Sub_1168), Tactic: 0, 1961[Float(3072,1)], 1915[Float(3072,1)] -> 1967[Float(3072,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Add_1169, Tactic: 1, 1964[Float(3072,1)], 1938[Float(3072,1)] -> 1968[Float(3072,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Add_1170, Tactic: 1, 1967[Float(3072,1)], 1961[Float(3072,1)] -> 1969[Float(3072,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1964 copy, Tactic: 0, 1964[Float(3072,1)] -> 1970[Float(3072,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1967 copy, Tactic: 0, 1967[Float(3072,1)] -> 1970[Float(3072,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1968 copy, Tactic: 0, 1968[Float(3072,1)] -> 1970[Float(3072,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1969 copy, Tactic: 0, 1969[Float(3072,1)] -> 1970[Float(3072,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_1217, Tactic: 5, 2715[Float(512,16,16)] -> 2028[Float(512,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(scudnn_winograd): Conv_1218, Tactic: -1343271414618805657, 2028[Float(512,16,16)] -> 2718[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): LeakyRelu_1219, Tactic: 4, 2718[Float(1024,16,16)] -> 2031[Float(1024,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(FusedConvActDirect): Conv_1220, Tactic: 4259839, 2031[Float(1024,16,16)] -> 2032[Float(255,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1225, Tactic: 0, 2032[Float(2,16,16)] -> 2037[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1230, Tactic: 0, 2032[Float(2,16,16)] -> 2042[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1235, Tactic: 0, 2032[Float(1,16,16)] -> 2047[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1240, Tactic: 0, 2032[Float(80,16,16)] -> 2052[Float(80,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1245, Tactic: 0, 2032[Float(2,16,16)] -> 2057[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1250, Tactic: 0, 2032[Float(2,16,16)] -> 2062[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1255, Tactic: 0, 2032[Float(1,16,16)] -> 2067[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1260, Tactic: 0, 2032[Float(80,16,16)] -> 2072[Float(80,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1265, Tactic: 0, 2032[Float(2,16,16)] -> 2077[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1270, Tactic: 0, 2032[Float(2,16,16)] -> 2082[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1275, Tactic: 0, 2032[Float(1,16,16)] -> 2087[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1280, Tactic: 0, 2032[Float(80,16,16)] -> 2092[Float(80,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2037 copy, Tactic: 0, 2037[Float(2,16,16)] -> 2093[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2057 copy, Tactic: 0, 2057[Float(2,16,16)] -> 2093[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2077 copy, Tactic: 0, 2077[Float(2,16,16)] -> 2093[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2042 copy, Tactic: 0, 2042[Float(2,16,16)] -> 2094[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2062 copy, Tactic: 0, 2062[Float(2,16,16)] -> 2094[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2082 copy, Tactic: 0, 2082[Float(2,16,16)] -> 2094[Float(2,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2047 copy, Tactic: 0, 2047[Float(1,16,16)] -> 2095[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2067 copy, Tactic: 0, 2067[Float(1,16,16)] -> 2095[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2087 copy, Tactic: 0, 2087[Float(1,16,16)] -> 2095[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2052 copy, Tactic: 0, 2052[Float(80,16,16)] -> 2112[Float(80,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2072 copy, Tactic: 0, 2072[Float(80,16,16)] -> 2112[Float(80,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2092 copy, Tactic: 0, 2092[Float(80,16,16)] -> 2112[Float(80,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Unary): Exp_1337, Tactic: 0, 2094[Float(6,16,16)] -> 2155[Float(6,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Shuffle): Reshape_1314 + Transpose_1315, Tactic: 0, 2112[Float(240,16,16)] -> 2131[Float(3,256,80)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1358, Tactic: 0, 2155[Float(1,16,16)] -> 2176[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1365, Tactic: 0, 2155[Float(1,16,16)] -> 2183[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1386, Tactic: 0, 2155[Float(1,16,16)] -> 2204[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1393, Tactic: 0, 2155[Float(1,16,16)] -> 2211[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1414, Tactic: 0, 2155[Float(1,16,16)] -> 2232[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1421, Tactic: 0, 2155[Float(1,16,16)] -> 2239[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Activation): Sigmoid_1338, Tactic: 0, 2111[Float(768)] -> 2156[Float(768)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(Sigmoid_1339, Mul_1565), Tactic: 4, 2149[Float(768,80)], 2396[Float(768,1)] -> 2397[Float(768,80)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1621 copy, Tactic: 0, 1621[Float(12288,80)] -> confs[Float(12288,80)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2009 copy, Tactic: 1002, 2009[Float(3072,80)] -> confs[Float(3072,80)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2397 copy, Tactic: 1002, 2397[Float(768,80)] -> confs[Float(768,80)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2177 + (Unnamed Layer* 1157) [Shuffle] + Mul_1360, Tactic: 0, 2176[Float(1,16,16)] -> 2178[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2184 + (Unnamed Layer* 1161) [Shuffle] + Mul_1367, Tactic: 0, 2183[Float(1,16,16)] -> 2185[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2205 + (Unnamed Layer* 1171) [Shuffle] + Mul_1388, Tactic: 0, 2204[Float(1,16,16)] -> 2206[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2212 + (Unnamed Layer* 1175) [Shuffle] + Mul_1395, Tactic: 0, 2211[Float(1,16,16)] -> 2213[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2233 + (Unnamed Layer* 1185) [Shuffle] + Mul_1416, Tactic: 0, 2232[Float(1,16,16)] -> 2234[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2240 + (Unnamed Layer* 1189) [Shuffle] + Mul_1423, Tactic: 0, 2239[Float(1,16,16)] -> 2241[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2178 copy, Tactic: 0, 2178[Float(1,16,16)] -> 2244[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2206 copy, Tactic: 0, 2206[Float(1,16,16)] -> 2244[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2234 copy, Tactic: 0, 2234[Float(1,16,16)] -> 2244[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2185 copy, Tactic: 0, 2185[Float(1,16,16)] -> 2245[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2213 copy, Tactic: 0, 2213[Float(1,16,16)] -> 2245[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2241 copy, Tactic: 0, 2241[Float(1,16,16)] -> 2245[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(2153 + (Unnamed Layer* 1144) [Shuffle], PWN(PWN(Sigmoid_1332, 2151 + (Unnamed Layer* 1141) [Shuffle] + Mul_1334), Sub_1336)), Tactic: 0, 2093[Float(6,16,16)] -> 2154[Float(6,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1344, Tactic: 0, 2154[Float(1,16,16)] -> 2162[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1351, Tactic: 0, 2154[Float(1,16,16)] -> 2169[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1372, Tactic: 0, 2154[Float(1,16,16)] -> 2190[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1379, Tactic: 0, 2154[Float(1,16,16)] -> 2197[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1400, Tactic: 0, 2154[Float(1,16,16)] -> 2218[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1407, Tactic: 0, 2154[Float(1,16,16)] -> 2225[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2163 + Add_1346, Tactic: 0, 2162[Float(1,16,16)] -> 2164[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2170 + Add_1353, Tactic: 0, 2169[Float(1,16,16)] -> 2171[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2191 + Add_1374, Tactic: 0, 2190[Float(1,16,16)] -> 2192[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2198 + Add_1381, Tactic: 0, 2197[Float(1,16,16)] -> 2199[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2219 + Add_1402, Tactic: 0, 2218[Float(1,16,16)] -> 2220[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Scale): 2226 + Add_1409, Tactic: 0, 2225[Float(1,16,16)] -> 2227[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2164 copy, Tactic: 0, 2164[Float(1,16,16)] -> 2242[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2192 copy, Tactic: 0, 2192[Float(1,16,16)] -> 2242[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2220 copy, Tactic: 0, 2220[Float(1,16,16)] -> 2242[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2171 copy, Tactic: 0, 2171[Float(1,16,16)] -> 2243[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2199 copy, Tactic: 0, 2199[Float(1,16,16)] -> 2243[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2227 copy, Tactic: 0, 2227[Float(1,16,16)] -> 2243[Float(1,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2242 copy, Tactic: 0, 2242[Float(3,16,16)] -> 2246[Float(3,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2244 copy, Tactic: 0, 2244[Float(3,16,16)] -> 2246[Float(3,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2243 copy, Tactic: 0, 2243[Float(3,16,16)] -> 2247[Float(3,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2245 copy, Tactic: 0, 2245[Float(3,16,16)] -> 2247[Float(3,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Div_1434, Tactic: 1, 2246[Float(6,16,16)], (Unnamed Layer* 1201) [Shuffle]_output[Float(1,1,1)] -> 2252[Float(6,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Div_1439, Tactic: 1, 2247[Float(6,16,16)], (Unnamed Layer* 1207) [Shuffle]_output[Float(1,1,1)] -> 2257[Float(6,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1444, Tactic: 0, 2252[Float(3,16,16)] -> 2262[Float(3,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1486, Tactic: 0, 2252[Float(3,16,16)] -> 2308[Float(3,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1465, Tactic: 0, 2257[Float(3,16,16)] -> 2285[Float(3,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): Slice_1507, Tactic: 0, 2257[Float(3,16,16)] -> 2331[Float(3,16,16)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(2350 + (Unnamed Layer* 1282) [Shuffle], Mul_1525), Sub_1526), Tactic: 1, 2326[Float(768,1)], 2280[Float(768,1)] -> 2352[Float(768,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(PointWiseV2): PWN(PWN(2353 + (Unnamed Layer* 1286) [Shuffle], Mul_1528), Sub_1529), Tactic: 1, 2349[Float(768,1)], 2303[Float(768,1)] -> 2355[Float(768,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Add_1530, Tactic: 1, 2352[Float(768,1)], 2326[Float(768,1)] -> 2356[Float(768,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(ElementWise): Add_1531, Tactic: 1, 2355[Float(768,1)], 2349[Float(768,1)] -> 2357[Float(768,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2352 copy, Tactic: 1002, 2352[Float(768,1)] -> 2358[Float(768,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2355 copy, Tactic: 0, 2355[Float(768,1)] -> 2358[Float(768,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2356 copy, Tactic: 0, 2356[Float(768,1)] -> 2358[Float(768,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2357 copy, Tactic: 1002, 2357[Float(768,1)] -> 2358[Float(768,1)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1602 copy, Tactic: 0, 1602[Float(12288,1,4)] -> boxes[Float(12288,1,4)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 1990 copy, Tactic: 0, 1990[Float(3072,1,4)] -> boxes[Float(3072,1,4)] [06/13/2021-16:49:48] [V] [TRT] Layer(Reformat): 2378 copy, Tactic: 0, 2378[Float(768,1,4)] -> boxes[Float(768,1,4)] [06/13/2021-16:49:48] [I] !!!!!!!!!!!!!!!!!!!!!!!!! Network Parameters !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! [06/13/2021-16:49:48] [I] The number of layers network->getNbLayers() = 1330 [06/13/2021-16:49:48] [I] The number of inputs network->getNbInputs() = 1 [06/13/2021-16:49:48] [I] The number of outputs network->getNbOutputs() = 2 [06/13/2021-16:49:48] [I] network->getInput(0)->getDimensions() mInputDims.nbDims = 4 [06/13/2021-16:49:48] [I] network->getOutput(0)->getDimensions() mOutputDims.nbDims = 4 [06/13/2021-16:49:48] [I] mParams.inputTensorNames[0].c_str() = input [06/13/2021-16:49:48] [I] mParams.outputTensorNames[0].c_str() = boxes [06/13/2021-16:49:48] [I] mParams.outputTensorNames[1].c_str() = confs [06/13/2021-16:49:48] [I] inputIndex = 0 [06/13/2021-16:49:48] [I] outputIndex = 1 [06/13/2021-16:49:48] [I] mParams.inputTensorNames.size() = 1 [06/13/2021-16:49:48] [I] mParams.outputTensorNames.size() = 2 [06/13/2021-16:49:48] [I] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! [06/13/2021-16:49:48] [I] ***************** infer() ***************** [06/13/2021-16:49:48] [V] [TRT] Allocated persistent device memory of size 586202624 [06/13/2021-16:49:48] [V] [TRT] Allocated activation device memory of size 106809344 [06/13/2021-16:49:48] [V] [TRT] Assigning persistent memory blocks for various profiles [06/13/2021-16:49:48] [I] **************** processInput () *************** [06/13/2021-16:49:48] [I] ***************** MY testInput() ***************** [06/13/2021-16:49:48] [I] testInput() mInputDims.d[0] inputN = 1 [06/13/2021-16:49:48] [I] testInput() mInputDims.d[1] inputC = 3 [06/13/2021-16:49:48] [I] testInput() mInputDims.d[2] inputH = 512 [06/13/2021-16:49:48] [I] testInput() mInputDims.d[3] inputW = 512 [06/13/2021-16:49:48] [I] inputC * inputH * inputW = 786432 [06/13/2021-16:49:48] [I] testInput() batchSize = 1 [06/13/2021-16:49:48] [I] Init network_width and network_height [06/13/2021-16:49:48] [I] network_width = 512 network_height = 512 [06/13/2021-16:49:48] [I] Input shape ( 1, 3, 512, 512 ) [06/13/2021-16:49:48] [I] testInput() buffers.size(mParams.inputTensorNames[0]) = 3145728 [06/13/2021-16:49:48] [I] testInput() buffers.size(mParams.outputTensorNames[0]) = 258048 [06/13/2021-16:49:48] [I] testInput() buffers.size(mParams.outputTensorNames[1]) = 5160960 [06/13/2021-16:49:48] [I] Before copy imageBGR to hostDataBuffer size = 3145728 [06/13/2021-16:49:48] [I] Copy imageBGR to hostDataBuffer [06/13/2021-16:49:48] [I] ***** DEBUG mParams.outputTensorNames[0] **************** [06/13/2021-16:49:48] [I] 0.501961 0.501961 0.501961 0.501961 0.501961 0.501961 0.501961 0.501961 0.501961 0.501961 0.501961 0.501961 0.501961 0.501961 0.501961MY testInput() hostDataBuffer[0] = 0.501961 [06/13/2021-16:49:48] [I] **************** End testInput() *************** [06/13/2021-16:49:48] [I] End processInput() [06/13/2021-16:49:49] [I] [06/13/2021-16:49:49] [I] ***** After copyOutputToHost mParams.outputTensorNames[0] **************** [06/13/2021-16:49:49] [I] -0.0109895 -0.0122474 0.0382841 0.032367 -0.00518608 -0.00616239 0.0533999 0.025859 0.0147225 -0.000875702 0.0630017 0.0121999 0.0367885 -0.00179921 0.0757617 0.00326224 0.0450882 -0.00158556 0.0937937 0.00152166 0.0606898 -0.00152787 0.110344 0.000993609 0.079052 -0.00167505 0.123316 0.00120799 0.0887583 -0.00210685 0.145404 0.00250952 0.102709 -0.00277613 0.166285 0.00517228 0.113104 -0.00266779 0.185159 0.00751337 0.130121 -0.00246795 0.200335 0.00900425 0.149735 -0.00182423 0.21335 0.00889644 0.16822 -0.0020542 0.223067 0.007738 0.187263 -0.00192973 0.234511 0.00677277 0.200354 -0.00210676 0.252541 0.00570062 0.21493 -0.00223262 0.267376 0.00559171 0.224948 -0.00165183 0.290942 0.00624707 0.237359 -0.0011399 0.310877 0.00669249 0.247721 -0.000505466 0.332431 0.00726103 0.257103 -0.00058467 0.353138 0.00720914 0.266771 -0.000385645 0.374864 0.00686 0.277488 *************** infer() before verifyOutput ********* [06/13/2021-16:49:49] [I] MY infer() mParams.inputTensorNames[0] = input [06/13/2021-16:49:49] [I] testInput() mInputDims.d[2] inputH = 512 [06/13/2021-16:49:49] [I] testInput() mInputDims.d[3] inputW = 512 [06/13/2021-16:49:49] [I] mOutput.hostBuffer.size() = 0 [06/13/2021-16:49:49] [I] mOutput.deviceBuffer.size() = 0 [06/13/2021-16:49:49] [I] *********** get_results() **************** [06/13/2021-16:49:49] [I] xratio = 3.75 yratio = 2.10938 [06/13/2021-16:49:49] [I] out2_shape[1] = 16128 out2_shape[2] = 80 max_confidence: 0.524158 max_confidence: 0.566472 max_confidence: 0.669095 max_confidence: 0.685285 max_confidence: 0.52993 max_confidence: 0.572626 max_confidence: 0.607285 max_confidence: 0.945504 max_confidence: 0.982784 max_confidence: 0.899539 max_confidence: 0.938261 max_confidence: 0.59616 max_confidence: 0.59921 max_confidence: 0.589837 max_confidence: 0.950862 max_confidence: 0.981552 max_confidence: 0.905111 max_confidence: 0.961031 max_confidence: 0.57072 max_confidence: 0.941276 max_confidence: 0.638248 max_confidence: 0.699272 max_confidence: 0.576758 max_confidence: 0.875716 max_confidence: 0.986292 max_confidence: 0.911899 max_confidence: 0.991495 max_confidence: 0.531442 max_confidence: 0.791023 max_confidence: 0.972212 max_confidence: 0.846673 max_confidence: 0.948562 max_confidence: 0.866212 max_confidence: 0.986818 max_confidence: 0.922376 max_confidence: 0.993374 max_confidence: 0.523231 max_confidence: 0.786649 max_confidence: 0.972069 max_confidence: 0.842725 max_confidence: 0.945427 max_confidence: 0.815084 max_confidence: 0.990022 max_confidence: 0.542442 max_confidence: 0.790645 max_confidence: 0.873439 max_confidence: 0.854823 max_confidence: 0.947079 max_confidence: 0.989148 max_confidence: 0.658619 max_confidence: 0.929384 max_confidence: 0.970719 Agerage Inference Latency: 115 ms &&&& PASSED TensorRT.sample_onnx_mnist # ./sample_onnx_mnist