Details

    • Type: Bug Bug
    • Status: Closed Closed (View Workflow)
    • Priority: Urgent Urgent
    • Resolution: Fixed
    • Component/s: NEP
    • Labels:
      None Labels
    • Customer:
      Airtel India

      Description

      Dear Team,

      We restarted the NEP services yesterday for the KK circle; however, the application is still not coming up. Upon checking the startup logs, we are observing continuous errors related to Level1Link loading. Kindly check and suggest

      1. server.log_KK 1 (1).tgz
        5.46 MB
        Basant Kumar
      2. server.log_KK 1 1.tgz
        178 kB
        Basant Kumar
      3. server.log.2026-03-10_KK 1 1.tgz
        1.15 MB
        Basant Kumar
      4. server.log.2026-03-12_KK.tgz
        5.42 MB
        Basant Kumar

        Activity

        Hide
        Basant Kumar added a comment -

        Dear Team,

        We restarted the NEP services yesterday for the KK circle; however, the application is still not coming up. Upon checking the startup logs, we are observing continuous errors related to Level1Link loading. Kindly check and suggest. Please find attached logs.

        2026-03-11 09:08:42,605 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-U_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_KKGGSN6_S1-U_VLAN1499_BestEffort' to IDU piece 'KPRVI2_7B9F001CEF174E7D884984A687961E84' has null From Component
        2026-03-11 09:08:42,820 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-U_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_KK-CIS-NDR-SPG-01_S1-U_VLAN1499_BestEffort' to IDU piece 'KPRVI2_CA2F6BEF9BEB4EA1B6529A348A19C528' has null From Component
        2026-03-11 09:08:42,967 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-MME_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_LNMME-2_S1-MME_VLAN1499_BestEffort' to IDU piece 'KPRVI2_FE5722B2668745568E6B00053AA8B044' has null From Component
        2026-03-11 09:08:43,142 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-U_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_KKGGSN4_S1-U_VLAN1499_BestEffort' to IDU piece 'KPRVI2_138D429A43044002BD50DDC79CD04F96' has null From Component
        2026-03-11 09:08:43,292 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-U_OOON_SRAN_GUTHA1_OOON_SRAN_GUTHA1_KKGGSN3_S1-U_VLAN2634_BestEffort' to IDU piece 'KKMWGUTHA1_3D3B7767613F4602AA5688C6E9301203' has null From Component
        2026-03-11 09:08:43,432 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-MME_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_LNMME-10_S1-MME_VLAN1499_BestEffort' to IDU piece 'KPRVI2_F20EB0B4745B43CFA8E13C945EB1F86B' has null From Component
        2026-03-11 09:08:43,634 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-U_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_KK-CIS-WFD-SPG-01_S1-U_VLAN1499_BestEffort' to IDU piece 'KPRVI2_D6AB1807E9CC441581F47C064D5E5404' has null From Component
        2026-03-11 09:08:43,781 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-MME_OOON_SRAN_GUTHA1_OOON_SRAN_GUTHA1_LNMME-10_S1-MME_VLAN2634_BestEffort' to IDU piece 'KKMWGUTHA1_8577BFC3A1EE41F392027D27C4698142' has null From Component
        2026-03-11 09:08:43,963 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-MME_OOON_SRAN_GUTHA1_OOON_SRAN_GUTHA1_LNMME-1_S1-MME_VLAN2634_BestEffort' to IDU piece 'KKMWGUTHA1_5868F0F5E27246399CFB690CC5CB881F' has null From Componen:

        2026-03-10 23:51:02,063 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 801692C5837C433998141CD4274D45A7
        com.mobinets.nps.model.network.Circuit S1-MME_KK-LBL4690-1_KK-LBL4690-1_LNMME-10_S1-MME_VLAN3484_BestEffort
        2026-03-10 23:52:29,071 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 8E524360E9374557BB5DBC9E6614C0F7
        com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_KAPUU3_OOON_SRAN_KAPUU3_MM_BLR845-11_S1-U_VLAN2732_BestEffort
        2026-03-10 23:53:55,808 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! FD62AE3E81824E65880C674FBDD7C688
        com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_KAPUU3_OOON_SRAN_KAPUU3_MM_BLR845-3_S1-U_VLAN2732_BestEffort
        2026-03-10 23:54:40,802 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 67DAAF30C88347F0A376AFF353158275
        com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_KAPUU3_OOON_SRAN_KAPUU3_MM_BLR845-6_S1-U_VLAN2732_BestEffort
        2026-03-10 23:58:09,907 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 610421E89A9C4765A4D9D83FB11D2F60
        com.mobinets.nps.model.network.Circuit S1-

        Additionally, since the circle was not coming up, we deployed NEP 562 on the KK circle because this level link issue fixed in BR after deploying this patch. After the deployment, the following warnings are continuously appearing in the logs. Kindly check this issue on priority.

        2026-03-11 13:39:36,981 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 87944C8D5816495D8
        EDC721536996CEB
        com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_KDKNR1_OOON_SRAN_KDKNR1_MM_BLR845-12_S1-U_VLAN1506_BestEffort
        2026-03-11 13:39:52,144 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 0C29E1D05F5244E19
        5ECA6ABA61F6AEC
        com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_SORKN1_OOON_SRAN_SORKN1_MM_BLR845-8_S1-U_VLAN3059_BestEffort
        2026-03-11 13:39:55,349 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! C7082654AD5E43738
        4F954175ADF3367
        com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_BG1231_OOON_SRAN_BG1231_MM_BLR845-8_S1-U_VLAN2800_BestEffort
        2026-03-11 13:40:13,293 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 610421E89A9C4765A
        4D9D83FB11D2F60
        com.mobinets.nps.model.network.Circuit S1-MME_OOON_SRAN_TLEKP1_OOON_SRAN_TLEKP1_LNMME-10_S1-MME_VLAN3108_BestEffort
        2026-03-11 13:40:26,608 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 18C7EED11D114C0BA
        2102FC315E20D5F
        com.mobinets.nps.model.network.Circuit S1-U_TBNN_SRAN_BL3819_TBNN_SRAN_BL3819_MM_BLR845-9_S1-U_VLAN2801_BestEffort
        2026-03-11 13:40:28,640 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 806AE5410FC94352A
        1D91951DA857801
        com.mobinets.nps.model.network.Circuit S1-U_TBNN_SRAN_BL4504_TBNN_SRAN_BL4504_MM_BLR845-1_S1-U_VLAN3484_BestEffort
        2026-03-11 13:40:37,899 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! F3CB4A3E910042488
        EF930BB54A5306A
        com.mobinets.nps.model.network.Circuit S1-U_TMLN_SRAN_MLR048_TMLN_SRAN_MLR048_KKGGSN2_S1-U_VLAN830_BestEffort
        2026-03-11 13:41:10,691 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 88095132DFE94C0B8
        81FB8354B2D8E77
        com.mobinets.nps.model.network.Circuit S1-MME_OOON_SRAN_TORA10_OOON_SRAN_TORA10_LNMME-7_S1-MME_VLAN2801_BestEffort
        2026-03-11 13:42:06,380 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 6D00B8BA26FE42CEA
        B2DF382DD6ACAC7
        com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_BIDRE1_OOON_SRAN_BIDRE1_MM_BLR845-9_S1-U_VLAN3291_BestEffort
        2026-03-11 13:42:27,848 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! EF75D2BBA2174B8C8
        5E4ABF2213DE712
        com.mobinets.nps.model.network.Circuit S1-U_TBNN_SRAN_BL4504_TBNN_SRAN_BL4504_MM_BLR845-8_S1-U_VLAN3484_BestEffort

        Show
        Basant Kumar added a comment - Dear Team, We restarted the NEP services yesterday for the KK circle; however, the application is still not coming up. Upon checking the startup logs, we are observing continuous errors related to Level1Link loading. Kindly check and suggest. Please find attached logs. 2026-03-11 09:08:42,605 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-U_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_KKGGSN6_S1-U_VLAN1499_BestEffort' to IDU piece 'KPRVI2_7B9F001CEF174E7D884984A687961E84' has null From Component 2026-03-11 09:08:42,820 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-U_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_KK-CIS-NDR-SPG-01_S1-U_VLAN1499_BestEffort' to IDU piece 'KPRVI2_CA2F6BEF9BEB4EA1B6529A348A19C528' has null From Component 2026-03-11 09:08:42,967 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-MME_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_LNMME-2_S1-MME_VLAN1499_BestEffort' to IDU piece 'KPRVI2_FE5722B2668745568E6B00053AA8B044' has null From Component 2026-03-11 09:08:43,142 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-U_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_KKGGSN4_S1-U_VLAN1499_BestEffort' to IDU piece 'KPRVI2_138D429A43044002BD50DDC79CD04F96' has null From Component 2026-03-11 09:08:43,292 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-U_OOON_SRAN_GUTHA1_OOON_SRAN_GUTHA1_KKGGSN3_S1-U_VLAN2634_BestEffort' to IDU piece 'KKMWGUTHA1_3D3B7767613F4602AA5688C6E9301203' has null From Component 2026-03-11 09:08:43,432 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-MME_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_LNMME-10_S1-MME_VLAN1499_BestEffort' to IDU piece 'KPRVI2_F20EB0B4745B43CFA8E13C945EB1F86B' has null From Component 2026-03-11 09:08:43,634 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-U_ZQ_OOON_SRAN_KPRVI2_ZQ_OOON_SRAN_KPRVI2_KK-CIS-WFD-SPG-01_S1-U_VLAN1499_BestEffort' to IDU piece 'KPRVI2_D6AB1807E9CC441581F47C064D5E5404' has null From Component 2026-03-11 09:08:43,781 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-MME_OOON_SRAN_GUTHA1_OOON_SRAN_GUTHA1_LNMME-10_S1-MME_VLAN2634_BestEffort' to IDU piece 'KKMWGUTHA1_8577BFC3A1EE41F392027D27C4698142' has null From Component 2026-03-11 09:08:43,963 ERROR [com.mobinets.nep.npt.model.domain.loader.version.impl.Level1LinkLoaderImpl] (pool-6-thread-3) Level-1Link from Circuit'S1-MME_OOON_SRAN_GUTHA1_OOON_SRAN_GUTHA1_LNMME-1_S1-MME_VLAN2634_BestEffort' to IDU piece 'KKMWGUTHA1_5868F0F5E27246399CFB690CC5CB881F' has null From Componen: 2026-03-10 23:51:02,063 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 801692C5837C433998141CD4274D45A7 com.mobinets.nps.model.network.Circuit S1-MME_KK-LBL4690-1_KK-LBL4690-1_LNMME-10_S1-MME_VLAN3484_BestEffort 2026-03-10 23:52:29,071 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 8E524360E9374557BB5DBC9E6614C0F7 com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_KAPUU3_OOON_SRAN_KAPUU3_MM_BLR845-11_S1-U_VLAN2732_BestEffort 2026-03-10 23:53:55,808 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! FD62AE3E81824E65880C674FBDD7C688 com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_KAPUU3_OOON_SRAN_KAPUU3_MM_BLR845-3_S1-U_VLAN2732_BestEffort 2026-03-10 23:54:40,802 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 67DAAF30C88347F0A376AFF353158275 com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_KAPUU3_OOON_SRAN_KAPUU3_MM_BLR845-6_S1-U_VLAN2732_BestEffort 2026-03-10 23:58:09,907 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 610421E89A9C4765A4D9D83FB11D2F60 com.mobinets.nps.model.network.Circuit S1- Additionally, since the circle was not coming up, we deployed NEP 562 on the KK circle because this level link issue fixed in BR after deploying this patch. After the deployment, the following warnings are continuously appearing in the logs. Kindly check this issue on priority. 2026-03-11 13:39:36,981 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 87944C8D5816495D8 EDC721536996CEB com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_KDKNR1_OOON_SRAN_KDKNR1_MM_BLR845-12_S1-U_VLAN1506_BestEffort 2026-03-11 13:39:52,144 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 0C29E1D05F5244E19 5ECA6ABA61F6AEC com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_SORKN1_OOON_SRAN_SORKN1_MM_BLR845-8_S1-U_VLAN3059_BestEffort 2026-03-11 13:39:55,349 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! C7082654AD5E43738 4F954175ADF3367 com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_BG1231_OOON_SRAN_BG1231_MM_BLR845-8_S1-U_VLAN2800_BestEffort 2026-03-11 13:40:13,293 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 610421E89A9C4765A 4D9D83FB11D2F60 com.mobinets.nps.model.network.Circuit S1-MME_OOON_SRAN_TLEKP1_OOON_SRAN_TLEKP1_LNMME-10_S1-MME_VLAN3108_BestEffort 2026-03-11 13:40:26,608 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 18C7EED11D114C0BA 2102FC315E20D5F com.mobinets.nps.model.network.Circuit S1-U_TBNN_SRAN_BL3819_TBNN_SRAN_BL3819_MM_BLR845-9_S1-U_VLAN2801_BestEffort 2026-03-11 13:40:28,640 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 806AE5410FC94352A 1D91951DA857801 com.mobinets.nps.model.network.Circuit S1-U_TBNN_SRAN_BL4504_TBNN_SRAN_BL4504_MM_BLR845-1_S1-U_VLAN3484_BestEffort 2026-03-11 13:40:37,899 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! F3CB4A3E910042488 EF930BB54A5306A com.mobinets.nps.model.network.Circuit S1-U_TMLN_SRAN_MLR048_TMLN_SRAN_MLR048_KKGGSN2_S1-U_VLAN830_BestEffort 2026-03-11 13:41:10,691 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 88095132DFE94C0B8 81FB8354B2D8E77 com.mobinets.nps.model.network.Circuit S1-MME_OOON_SRAN_TORA10_OOON_SRAN_TORA10_LNMME-7_S1-MME_VLAN2801_BestEffort 2026-03-11 13:42:06,380 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! 6D00B8BA26FE42CEA B2DF382DD6ACAC7 com.mobinets.nps.model.network.Circuit S1-U_OOON_SRAN_BIDRE1_OOON_SRAN_BIDRE1_MM_BLR845-9_S1-U_VLAN3291_BestEffort 2026-03-11 13:42:27,848 WARN [com.mobinets.npt.network.routing.NetworkRoutingManager] (pool-8-thread-1) Level-1-Link Not found!!!!!!!! EF75D2BBA2174B8C8 5E4ABF2213DE712 com.mobinets.nps.model.network.Circuit S1-U_TBNN_SRAN_BL4504_TBNN_SRAN_BL4504_MM_BLR845-8_S1-U_VLAN3484_BestEffort
        Hide
        Srishti Kashyap added a comment -

        Build 3.7.71.568 released//possible fix:caching links and monitory logs

        Show
        Srishti Kashyap added a comment - Build 3.7.71.568 released//possible fix:caching links and monitory logs
        Hide
        Srishti Kashyap added a comment -

        Build 3.7.71.570 is released with monitoring logs

        Show
        Srishti Kashyap added a comment - Build 3.7.71.570 is released with monitoring logs
        Hide
        Bessem Manita added a comment -

        possible fix was released in patch 3.7.71.571

        Show
        Bessem Manita added a comment - possible fix was released in patch 3.7.71.571
        Hide
        Abir Messaikeh added a comment -

        applied on PROD and fixed

        Show
        Abir Messaikeh added a comment - applied on PROD and fixed

          People

          • Assignee:
            Abir Messaikeh
            Reporter:
            Basant Kumar
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Due:
              Created:
              Updated:
              Resolved:
              Planned Start:
              Planned End:
              Actual Start:
              Date of Baselining:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0 minutes
              0m
              Logged:
              Time Spent - 1 day, 2 hours
              1d 2h

                Drag and Drop