Details
-
Type:
Bug
-
Status:
Closed
(View Workflow)
-
Priority:
Normal
-
Resolution: Fixed
-
Labels:None Labels
-
Customer:Zain Kuwait
Description
Kindly check as today we have more than 49k assets in the WF under pending deletion from Passive & IT.As checked in inventories it has last update of today’s date. Pl check and do the needful:
Attachments
Activity
-
- Time Spent:
- 6 hours
-
Issue raised by customer around 50 K line items in WF, did all the checkup and raised issue with logs to L3 team
-
- Time Spent:
- 1 hour
-
Raised Ticket with L3 team
| Field | Original Value | New Value |
|---|---|---|
| Gantt Options | Milestone (set to milestone: having a due date but zero effort) | |
| Planned Start | 2025-11-20 24:00 (milestone: set planned start date to due date) | |
| Planned End | 2025-11-20 24:00 (milestone: set planned end date to due date) |
| Attachment | WF1.png [ 122100 ] |
| Attachment | WF.png [ 122101 ] |
| Assignee | Khaled Khalil [ kkhalil ] | Mustapha Al-Hage [ malhage ] |
-
- Time Spent:
- 3 hours, 30 minutes
-
Did validation and provide scerios consisting of issues with L3 team
-
- Time Spent:
- 5 hours
-
Provide logs to L3 from time to time for troubleshoot and stop all application along with db and export db dump then start the application after upgrade firmware by zain team.
-
- Time Spent:
- 30 minutes
-
Testing of import node in test to check in prod wf
-
- Time Spent:
- 7 hours
-
Troubleshoot for ftp dump related issue and joined meeting with cybermak team and provide many logs to L3 for troubleshoot Passive & IT related issue and import db dump to test platform.
-
- Time Spent:
- 1 hour
-
Customer raised concern of not updating the nep data , check and raised with l3
| Remaining Estimate | 0 minutes [ 0 ] | |
| Time Spent | 30 minutes [ 1800 ] | |
| Worklog Id | 283917 [ 283917 ] |
| Baseline Start | 2025-11-20 24:00 (set baseline based of initial work logging) | |
| Baseline End | 2025-11-20 24:00 (set baseline based of initial work logging) |
| Time Spent | 30 minutes [ 1800 ] | 5 hours, 30 minutes [ 19800 ] |
| Worklog Id | 283928 [ 283928 ] |
| Time Spent | 5 hours, 30 minutes [ 19800 ] | 1 day, 4 hours, 30 minutes [ 45000 ] |
| Worklog Id | 283932 [ 283932 ] |
-
- Time Spent:
- 1 hour
-
Provide the log and check IP configuration on test platform.
| Time Spent | 1 day, 4 hours, 30 minutes [ 45000 ] | 1 day, 5 hours, 30 minutes [ 48600 ] |
| Worklog Id | 284009 [ 284009 ] |
-
- Time Spent:
- 1 hour, 30 minutes
-
After checking the revert from L3 , validate the same and forward to cybermak team also discussion happen.
-
- Time Spent:
- 1 hour, 30 minutes
-
Restart the test server and share log from prod to L3 for rectify the issue.
-
- Time Spent:
- 1 hour
-
Ask Bessem to restart the test server and after restart check the status as well
| Time Spent | 1 day, 5 hours, 30 minutes [ 48600 ] | 1 day, 7 hours [ 54000 ] |
| Worklog Id | 284105 [ 284105 ] |
| Time Spent | 1 day, 7 hours [ 54000 ] | 2 days [ 57600 ] |
| Worklog Id | 284113 [ 284113 ] |
| Time Spent | 2 days [ 57600 ] | 2 days, 1 hour, 30 minutes [ 63000 ] |
| Worklog Id | 284118 [ 284118 ] |
| Time Spent | 2 days, 1 hour, 30 minutes [ 63000 ] | 2 days, 5 hours [ 75600 ] |
| Worklog Id | 284123 [ 284123 ] |
| Time Spent | 2 days, 5 hours [ 75600 ] | 2 days, 6 hours [ 79200 ] |
| Worklog Id | 284127 [ 284127 ] |
| Time Spent | 2 days, 6 hours [ 79200 ] | 3 days, 4 hours [ 100800 ] |
| Worklog Id | 284132 [ 284132 ] |
-
- Time Spent:
- 1 hour
-
Discussion with salim regarding the fix and also ask L3 to provide permanaent fix
-
- Time Spent:
- 1 hour, 30 minutes
-
Discussion with salim and validate the scenrio and ask L3 to provide script
| Attachment | update_passive_node_approval_status.txt [ 122812 ] |
We still need script with L2Rejected Deletion status
| Status | Open Bug [ 10108 ] | Dev Scheduled [ 10014 ] |
| Assignee | Mustapha Al-Hage [ malhage ] | Bessem Manita [ bmanita ] |
Hi Abir,
Please find attached clean up script. Server restart is required.
BR,
| Attachment | update_passive_node_L2RejectedDeletion_status.txt [ 122820 ] |
| Status | Dev Scheduled [ 10014 ] | Implementation in progress [ 10016 ] |
| Status | Implementation in progress [ 10016 ] | To Be Released [ 10400 ] |
| Status | To Be Released [ 10400 ] | Ready for QA [ 10023 ] |
| Assignee | Bessem Manita [ bmanita ] | Daljeet Singh Virdi [ dsvirdi ] |
| Time Spent | 3 days, 4 hours [ 100800 ] | 3 days, 5 hours [ 104400 ] |
| Worklog Id | 284627 [ 284627 ] |
| Time Spent | 3 days, 5 hours [ 104400 ] | 3 days, 6 hours [ 108000 ] |
| Worklog Id | 284631 [ 284631 ] |
| Time Spent | 3 days, 6 hours [ 108000 ] | 3 days, 7 hours, 30 minutes [ 113400 ] |
| Worklog Id | 284636 [ 284636 ] |
-
- Time Spent:
- 4 hours
-
Checked the log and script executed status on db and work with L3 to check script apply status and then re-run script again after working hours and restart the nep.
-
- Time Spent:
- 4 hours
-
Check the NEP status of Prod and found patches not deployed as it got stuck and terminated, also check the approval status in each inventory
| Status | Ready for QA [ 10023 ] | QA In Progress [ 10015 ] |
-
- Time Spent:
- 1 hour, 30 minutes
-
Apply the script which shared by dev team then restart the nep.
| Time Spent | 3 days, 7 hours, 30 minutes [ 113400 ] | 4 days, 3 hours, 30 minutes [ 127800 ] |
| Worklog Id | 285308 [ 285308 ] |
| Time Spent | 4 days, 3 hours, 30 minutes [ 127800 ] | 4 days, 5 hours [ 133200 ] |
| Worklog Id | 285313 [ 285313 ] |
-
- Time Spent:
- 4 hours
-
Check the status on each inventory and provide update to L3 team
| Time Spent | 4 days, 5 hours [ 133200 ] | 1 week, 1 hour [ 147600 ] |
| Worklog Id | 285714 [ 285714 ] |
| Time Spent | 1 week, 1 hour [ 147600 ] | 1 week, 3 hours, 30 minutes [ 156600 ] |
| Worklog Id | 285720 [ 285720 ] |
-
- Time Spent:
- 2 hours
-
Validate the same and ask closure from the customer
-
- Time Spent:
- 2 hours
-
Validate the status of inventories
| Status | QA In Progress [ 10015 ] | Closed [ 6 ] |
| Resolution | Fixed [ 1 ] |
| Time Spent | 1 week, 3 hours, 30 minutes [ 156600 ] | 1 week, 5 hours [ 162000 ] |
| Worklog Id | 285720 [ 285720 ] |
| Time Spent | 1 week, 5 hours [ 162000 ] | 1 week, 7 hours [ 169200 ] |
| Worklog Id | 288051 [ 288051 ] |
| Time Spent | 1 week, 7 hours [ 169200 ] | 1 week, 1 day, 1 hour [ 176400 ] |
| Worklog Id | 288054 [ 288054 ] |
| Transition | Time In Source Status | Execution Times | Last Executer | Last Execution Date | |||||
|---|---|---|---|---|---|---|---|---|---|
|
9d 5h 37m | 1 | Abir Messaikeh | 26/Nov/25 10:19 AM | |||||
|
2h 33m | 1 | Bessem Manita | 26/Nov/25 12:52 PM | |||||
|
6s | 1 | Bessem Manita | 26/Nov/25 12:52 PM | |||||
|
1h 40m | 1 | Khaled Khalil | 26/Nov/25 2:33 PM | |||||
|
6d 16h 52m | 1 | Daljeet Singh Virdi | 03/Dec/25 7:25 AM | |||||
|
26d 20m | 1 | Daljeet Singh Virdi | 29/Dec/25 7:46 AM |
|
Links Hierarchy |
 Documentation
|
Dear Daljeet,
After analysis, it appears that the test NEP was referencing the prod WF, which caused requests to be created in the WF prod environment that did not match the prod NEP. I have reviewed the configuration files for NEP, WF on prod and test platform, and everything is correctly configured. It seems this was a temporary issue related to swapped IPs.
Dear @Manjit Kumar, please continue monitoring this behaviour over the next few days.
Dear @Daljeet Singh Virdi,please validate all current requests in the prod WF and reject those that do not match the NEP status.
For the rejected requests, their status in NEP will appear as L1RejectedDeletion, which represents incorrect information. Please advise whether we should reset their status to null or retain the L1RejectedDeletion value.
The attached script will update the approval status to null if you agree with the customer to reset the passive node approval status. Server restart will be required after applying the script.
BR,
Bessem