--- running download miniprod2017
--- Start date:
Wed Jul 24 03:20:01 CDT 2019
--- setup
--- Setup NOvA production validation
User: [01;34mnovapro[0m
Use with SRT: [01;34mfalse[0m
Base directory: [01;34m/nova/app/users/novapro/prod_valid/python[0m
Grid output: [01;34m/nova/ana/users/novapro/prod_valid/condor_output[0m
Web output: [01;34m/nusoft/app/web/htdoc/nova/production[0m
--- run
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_fd_cosmic_full_v1_goodruns
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_fd_cosmic_full_v1_goodruns
Fetching data for prod_mrbremcaf_R17-09-05-prod4recopreview.f_fd_cosmic_full_v1_goodruns
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_fd_genie_nonswap_fhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_fd_genie_nonswap_fhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_fd_genie_fluxswap_fhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_fd_genie_fluxswap_fhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_repid_R17-09-05-prod4recopreview.e_fd_genie_nonswap_fhc_nova_v08_full_v1
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_fd_genie_nonswap_fhc_nova_v08_full_v1
Fetching data for prod_repid_R17-09-05-prod4recopreview.e_fd_genie_fluxswap_fhc_nova_v08_full_v1
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_fd_genie_fluxswap_fhc_nova_v08_full_v1
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_fd_genie_nonswap_rhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_fd_genie_nonswap_rhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_fd_genie_fluxswap_rhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_fd_genie_fluxswap_rhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_repid_R17-09-05-prod4recopreview.e_fd_genie_nonswap_rhc_nova_v08_full_v1
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_fd_genie_nonswap_rhc_nova_v08_full_v1
Fetching data for prod_repid_R17-09-05-prod4recopreview.e_fd_genie_fluxswap_rhc_nova_v08_full_v1
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_fd_genie_fluxswap_rhc_nova_v08_full_v1
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_nd_genie_nonswap_fhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_nd_genie_nonswap_fhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_repid_R17-09-05-prod4recopreview.d_nd_genie_nonswap_fhc_nova_v08_full_v1
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_nd_genie_nonswap_fhc_nova_v08_full_v1
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_nd_genie_nonswap_rhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_nd_genie_nonswap_rhc_nova_v08_full_v1_addShortSimpleCVN
Fetching data for prod_repid_R17-09-05-prod4recopreview.d_nd_genie_nonswap_rhc_nova_v08_full_v1
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_nd_genie_nonswap_rhc_nova_v08_full_v1
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_nd_numi_fhc_full_v1_addShortSimpleCVN
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_nd_numi_fhc_full_v1_addShortSimpleCVN_goodruns
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_nd_numi_fhc_full_v1_addShortSimpleCVN_goodruns
Fetching data for prod_repid_R17-09-05-prod4recopreview.c_nd_numi_fhc_full_v1
Fetching data for prod_repid_R17-09-05-prod4recopreview.c_nd_numi_fhc_full_v1_goodruns
Fetching data for prod_caf_R17-09-05-prod4recopreview.c_nd_numi_fhc_full_v1_goodruns
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_nd_numi_rhc_full_v1_addShortSimpleCVN
Fetching data for prod_repid_R17-09-05-prod4recopreview.f_nd_numi_rhc_full_v1_addShortSimpleCVN_goodruns
Fetching data for prod_caf_R17-09-05-prod4recopreview.f_nd_numi_rhc_full_v1_addShortSimpleCVN_goodruns
Fetching data for prod_repid_R17-09-05-prod4recopreview.c_nd_numi_rhc_full_v1
Fetching data for prod_repid_R17-09-05-prod4recopreview.c_nd_numi_rhc_full_v1_goodruns
Fetching data for prod_caf_R17-09-05-prod4recopreview.c_nd_numi_rhc_full_v1_goodruns
Fetching data for prod_pid_S17-06-19_nd_genie_nonswap_fhc_nova_v08_full_v1
Fetching data for prod_caf_S17-06-19_nd_genie_nonswap_fhc_nova_v08_full_v1
Fetching data for prod_decaf_S17-06-19_nd_genie_nonswap_fhc_nova_v08_full_nue_or_numu_or_nus_contain_v1
Fetching data for matched_slicertest_prod_caf_S17-06-19_nd_genie_nonswap_fhc_nova_v08_full_v2_snapshot20170720
Fetching data for matched_slicertest_prod_caf_R17-03-01-prod3reco.d_nd_genie_nonswap_fhc_nova_v08_full_v2_snapshot20170720
Fetching data for prod_pid_S17-06-19_nd_genie_nonswap_fhc_nova_v08_period2_v1
Fetching data for prod_caf_S17-06-19_nd_genie_nonswap_fhc_nova_v08_period2_v1
Fetching data for prod_decaf_S17-06-19_nd_genie_nonswap_fhc_nova_v08_period2_nue_or_numu_or_nus_contain_v1
Fetching data for prod_pid_S17-06-19_nd_genie_nonswap_fhc_nova_v08_period3_v1
Fetching data for prod_caf_S17-06-19_nd_genie_nonswap_fhc_nova_v08_period3_v1
Fetching data for prod_decaf_S17-06-19_nd_genie_nonswap_fhc_nova_v08_period3_nue_or_numu_or_nus_contain_v1
Fetching data for prod_pid_S17-06-19_nd_genie_nonswap_fhc_nova_v08_period5_v1
(psycopg2.OperationalError) server closed the connection unexpectedly
This probably means the server terminated abnormally
before or while processing the request.
[SQL: 'SELECT count(summary.file_id) AS count_1, sum(summary.file_size_in_bytes) AS sum_1, sum(summary.event_count) AS sum_2 \nFROM (SELECT DISTINCT ON (data_files.file_id) data_files.file_id AS file_id, data_files.file_size_in_bytes AS file_size_in_bytes, data_files.event_count AS event_count \nFROM data_files JOIN data_tiers ON data_tiers.data_tier_id = data_files.data_tier_id JOIN data_files_param_values AS dfpv_pid_base_release ON data_files.file_id = dfpv_pid_base_release.file_id JOIN file_types ON file_types.file_type_id = data_files.file_type_id JOIN data_files_param_values AS dfpv_nova_detectorid ON data_files.file_id = dfpv_nova_detectorid.file_id JOIN data_files_runs ON data_files.file_id = data_files_runs.file_id JOIN runs ON runs.run_id = data_files_runs.run_id JOIN data_files_param_values AS dfpv_simulated_genieflavorset ON data_files.file_id = dfpv_simulated_genieflavorset.file_id JOIN data_files_param_values AS dfpv_nova_special ON data_files.file_id = dfpv_nova_special.file_id JOIN data_files_param_values AS dfpv_nova_systematic ON data_files.file_id = dfpv_nova_systematic.file_id JOIN data_files_param_values AS dfpv_nova_skim ON data_files.file_id = dfpv_nova_skim.file_id JOIN data_files_param_values AS dfpv_nova_label ON data_files.file_id = dfpv_nova_label.file_id JOIN data_files_param_values AS dfpv_nova_hornconfig ON data_files.file_id = dfpv_nova_hornconfig.file_id JOIN data_files_param_values AS dfpv_nova_hornpolarity ON data_files.file_id = dfpv_nova_hornpolarity.file_id JOIN data_files_param_values AS dfpv_simulated_cryflavorset ON data_files.file_id = dfpv_simulated_cryflavorset.file_id JOIN data_files_param_values AS dfpv_simulated_cryused ON data_files.file_id = dfpv_simulated_cryused.file_id JOIN data_files_param_values AS dfpv_simulated_genieused ON data_files.file_id = dfpv_simulated_genieused.file_id JOIN data_files_param_values AS dfpv_simulated_singlepflavorset ON data_files.file_id = dfpv_simulated_singlepflavorset.file_id JOIN data_files_param_values AS dfpv_simulated_singlepused ON data_files.file_id = dfpv_simulated_singlepused.file_id JOIN data_files_param_values AS dfpv_nova_subversion ON data_files.file_id = dfpv_nova_subversion.file_id \nWHERE data_tiers.data_tier = %(data_tier_1)s AND dfpv_pid_base_release.param_type_id = 110 AND dfpv_pid_base_release.param_value_id = %(param_value_id_1)s AND lower(file_types.file_type_desc) = %(param_1)s AND dfpv_nova_detectorid.param_type_id = 86 AND dfpv_nova_detectorid.param_value_id = %(param_value_id_2)s AND runs.run_number >= %(run_number_1)s AND runs.run_number <= %(run_number_2)s AND dfpv_simulated_genieflavorset.param_type_id = 101 AND dfpv_simulated_genieflavorset.param_value_id = %(param_value_id_3)s AND dfpv_nova_special.param_type_id = 95 AND dfpv_nova_special.param_value_id = %(param_value_id_4)s AND dfpv_nova_systematic.param_type_id = 230 AND dfpv_nova_systematic.param_value_id = %(param_value_id_5)s AND dfpv_nova_skim.param_type_id = 231 AND dfpv_nova_skim.param_value_id = %(param_value_id_6)s AND dfpv_nova_label.param_type_id = 83 AND dfpv_nova_label.param_value_id = %(param_value_id_7)s AND dfpv_nova_hornconfig.param_type_id = 88 AND dfpv_nova_hornconfig.param_value_id = %(param_value_id_8)s AND dfpv_nova_hornpolarity.param_type_id = 87 AND dfpv_nova_hornpolarity.param_value_id = any(%(any_1)s) AND dfpv_simulated_cryflavorset.param_type_id = 99 AND dfpv_simulated_cryflavorset.param_value_id = %(param_value_id_9)s AND dfpv_simulated_cryused.param_type_id = 100 AND dfpv_simulated_cryused.param_value_id = %(param_value_id_10)s AND dfpv_simulated_genieused.param_type_id = 102 AND dfpv_simulated_genieused.param_value_id = %(param_value_id_11)s AND dfpv_simulated_singlepflavorset.param_type_id = 104 AND dfpv_simulated_singlepflavorset.param_value_id = %(param_value_id_12)s AND dfpv_simulated_singlepused.param_type_id = 106 AND dfpv_simulated_singlepused.param_value_id = %(param_value_id_13)s AND dfpv_nova_subversion.param_type_id = 85 AND dfpv_nova_subversion.param_value_id = %(param_value_id_14)s AND data_files.retired_date IS NULL AND data_files.file_content_status_id = 2 AND (EXISTS (SELECT 1 \nFROM data_file_locations \nWHERE data_file_locations.file_id = data_files.file_id))) AS summary'] [parameters: {'param_value_id_2': 363055L, 'param_value_id_3': 902227L, 'param_value_id_1': 6670056L, 'param_value_id_6': 2567556L, 'param_value_id_7': 1374997L, 'param_value_id_4': 665733L, 'param_value_id_5': 2567555L, 'data_tier_1': 'pid', 'param_value_id_8': 902203L, 'param_value_id_9': 902205L, 'param_1': 'importedsimulated', 'run_number_1': 11926L, 'run_number_2': 12086L, 'param_value_id_10': 902206L, 'param_value_id_11': 902208L, 'param_value_id_12': 902212L, 'param_value_id_13': 902213L, 'param_value_id_14': 363060L, 'any_1': [363057L, 679049L]}] (Background on this error at: //sqlalche.me/e/e3q8): retrying in 1 s
(psycopg2.OperationalError) FATAL: the database system is in recovery mode
(Background on this error at: //sqlalche.me/e/e3q8): retrying in 2 s
(psycopg2.OperationalError) FATAL: the database system is in recovery mode
(Background on this error at: //sqlalche.me/e/e3q8): retrying in 4 s
(psycopg2.OperationalError) FATAL: the database system is in recovery mode
(Background on this error at: //sqlalche.me/e/e3q8): retrying in 8 s
Fetching data for prod_caf_S17-06-19_nd_genie_nonswap_fhc_nova_v08_period5_v1
Fetching data for prod_decaf_S17-06-19_nd_genie_nonswap_fhc_nova_v08_period5_nue_or_numu_or_nus_contain_v1
Fetching data for prod_pid_S17-06-19_nd_numi_fhc_full_v1
Fetching data for prod_caf_S17-06-19_nd_numi_fhc_full_v1
Fetching data for prod_decaf_S17-06-19_nd_numi_fhc_full_nue_or_numu_or_nus_contain_v1
Fetching data for matched_slicertest_prod_caf_S17-06-19_nd_numi_fhc_full_v2_snapshot20170720
Fetching data for matched_slicertest_prod_caf_R17-03-01-prod3reco.d_nd_numi_fhc_full_v2_snapshot20170720
Fetching data for prod_pid_S17-06-19_nd_numi_fhc_period2_v1
Fetching data for prod_caf_S17-06-19_nd_numi_fhc_period2_v1
Fetching data for prod_decaf_S17-06-19_nd_numi_fhc_period2_nue_or_numu_or_nus_contain_v1
Fetching data for prod_pid_S17-06-19_nd_numi_fhc_period3_v1
Fetching data for prod_caf_S17-06-19_nd_numi_fhc_period3_v1
Fetching data for prod_decaf_S17-06-19_nd_numi_fhc_period3_nue_or_numu_or_nus_contain_v1
Fetching data for prod_pid_S17-06-19_nd_numi_fhc_period5_v1
Fetching data for prod_caf_S17-06-19_nd_numi_fhc_period5_v1
Fetching data for prod_decaf_S17-06-19_nd_numi_fhc_period5_nue_or_numu_or_nus_contain_v1
--- done
--- End date:
Wed Jul 24 04:38:09 CDT 2019
---
