Svoboda | Graniru | BBC Russia | Golosameriki | Facebook
BBC RussianHomePhabricator
Log In
Create Task
Maniphest T314664

[infra] Decommission the Grid Engine infrastructure
Open, Stalled, HighPublic
Actions

Description

This task is tracking the removal of Grid Engine-specific bits from the Toolforge infrastructure. It is effectively blocked on migrating tools off the grid, which is tracked separately as T313405: Migrate remaining tools off Gridengine.

Before Thursday shutdown window:

  • Stop alerting

Plan for Thursday (C10):

Then afterwards:

Details

SubjectRepoBranchLines +/-
hieradata: Drop defusedxml dependency from cloudcuminsoperations/puppetproduction+1 -2
P:toolforge: move webservice CLI to the CLI profileoperations/puppetproduction+29 -49
Remove Grid Engine supportcloud/wmcs-cookbooksmain+0 -2 K
dynamicproxy: cleanup after removing toolforge supportoperations/puppetproduction+44 -120
Remove Toolforge grid engineoperations/puppetproduction+12 -3 K
P:toolforge::proxy: drop grid engine dynamicproxy supportoperations/puppetproduction+248 -421
misctools: Remove oge-crontab scriptlabs/toollabsmaster+1 -361
Remove jobutils binary packagelabs/toollabsmaster+2 -1 K
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT364293 [infra,k8s] Move to kubernetes PAVs and drop kyverno
 OpenSlst2020T372697 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.31
 OpenaborreroT362869 [k8s,infra] Upgrade Toolforge to Uwubernetes (1.30)
 OpenfnegriT362868 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.29
 OpenRaymond_NdibeT362867 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.28
 In ProgressRaymond_NdibeT359641 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.27
Restricted Task
 ResolvedSlst2020T327025 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.26
 ResolvedaborreroT316107 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.25
 ResolvedaborreroT307651 Upgrade Toolforge Kubernetes to version 1.24
 ResolvedNoneT360699 Toolsbeta: migrate to Debian Bullseye or later
 OpendcaroT311897 Toolforge: migrate to Debian Bullseye or later
 StalleddcaroT314665 Toolforge: Replace all bastion with grid-less bookworm based bastion hosts
 ResolvedtaaviT361223 Upgrade Toolforge front proxies to Bookworm
 InvalidNoneT197804 Puppet: forbid new Python2 code
 ResolvedtaaviT218427 Upgrade various Toolforge infrastructure scripts from Python 2 to Python 3
 ResolvedtaaviT358320 [toolforge-webservice] Remove old webservice-runner code
 StalleddcaroT314664 [infra] Decommission the Grid Engine infrastructure
 ResolvedkomlaT313405 Migrate remaining tools off Gridengine
 DeclinedNoneT316124 Make Grid Engine tooling emit deprecation warnings
 ResolvedtaaviT329619 Toolforge: decide what to do with tools that have 'stretch' in their service manifests
 ResolvedAndrewT353351 Provide tools for disabling the grid for specific tools
 ResolvedAndrewT353642 Relocate disable-tool-archive-dbs.service
 ResolvedtaaviT358333 Remove toolschecker grid engine checks
 ResolvedtaaviT359934 [infra] Archive grid engine related infrastructure tools
 ResolvedtaaviT359935 [infra] Archive grid engine related Gerrit repositories

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
taavi added a parent task: T358320: [toolforge-webservice] Remove old webservice-runner code.Feb 23 2024, 10:19 AM
taavi added a subtask: T358333: Remove toolschecker grid engine checks.Feb 23 2024, 12:01 PM
taavi closed subtask T358333: Remove toolschecker grid engine checks as Resolved.Feb 23 2024, 1:42 PM
taavi claimed this task.Mar 5 2024, 2:45 PM
dcaro subscribed.Mar 5 2024, 3:06 PM
gerritbot added a comment.Mar 12 2024, 11:32 AM

Change 1010503 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::proxy: drop grid engine dynamicproxy support

https://gerrit.wikimedia.org/r/1010503

gerritbot added a comment.Mar 12 2024, 11:32 AM

Change 1010504 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] dynamicproxy: cleanup after removing toolforge support

https://gerrit.wikimedia.org/r/1010504

CodeReviewBot added a comment.Mar 12 2024, 1:11 PM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/tools-webservice/-/merge_requests/31

Remove grid engine support

taavi edited projects, added Toolforge (Toolforge iteration 07); removed Toolforge.Mar 12 2024, 1:14 PM
dcaro renamed this task from Toolforge: Decommission the Grid Engine infrastructure to [infra] Decommission the Grid Engine infrastructure.Mar 12 2024, 1:21 PM
dcaro triaged this task as High priority.
CodeReviewBot added a comment.Mar 12 2024, 1:24 PM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/disable-tool/-/merge_requests/18

Drop Grid Engine support

gerritbot added a comment.Mar 12 2024, 1:25 PM

Change 1010517 had a related patch set uploaded (by Majavah; author: Majavah):

[labs/toollabs@master] Remove jobutils binary package

https://gerrit.wikimedia.org/r/1010517

gerritbot added a comment.Mar 12 2024, 1:25 PM

Change 1010518 had a related patch set uploaded (by Majavah; author: Majavah):

[labs/toollabs@master] misctools: Remove oge-crontab script

https://gerrit.wikimedia.org/r/1010518

taavi updated the task description. (Show Details)Mar 12 2024, 1:27 PM
taavi updated the task description. (Show Details)
gerritbot added a comment.Mar 12 2024, 1:48 PM

Change 1010520 had a related patch set uploaded (by Majavah; author: Majavah):

[cloud/wmcs-cookbooks@main] Remove Grid Engine support

https://gerrit.wikimedia.org/r/1010520

taavi updated the task description. (Show Details)Mar 12 2024, 1:48 PM
taavi updated the task description. (Show Details)Mar 12 2024, 2:10 PM
dcaro awarded a token.Mar 13 2024, 11:35 AM
taavi updated the task description. (Show Details)Mar 13 2024, 11:45 AM
taavi updated the task description. (Show Details)
Stashbot added a comment.Mar 13 2024, 12:14 PM

Mentioned in SAL (#wikimedia-cloud) [2024-03-13T12:14:52Z] <taavi> MariaDB [prometheusconfig]> delete from alerts where name = 'GridQueueProblem'; # T314664

taavi updated the task description. (Show Details)Mar 13 2024, 12:16 PM
taavi updated the task description. (Show Details)
taavi updated the task description. (Show Details)Mar 13 2024, 12:24 PM
taavi removed a subtask: T314665: Toolforge: Replace all bastion with grid-less bookworm based bastion hosts.Mar 13 2024, 12:29 PM
taavi added a parent task: T314665: Toolforge: Replace all bastion with grid-less bookworm based bastion hosts.
taavi updated the task description. (Show Details)Mar 13 2024, 12:51 PM
taavi updated the task description. (Show Details)Mar 13 2024, 1:00 PM
taavi closed subtask T359935: [infra] Archive grid engine related Gerrit repositories as Resolved.Mar 13 2024, 1:17 PM
gerritbot added a comment.Mar 13 2024, 1:26 PM

Change 1010892 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] Remove Toolforge grid engine

https://gerrit.wikimedia.org/r/1010892

taavi updated the task description. (Show Details)Mar 14 2024, 9:30 AM
taavi closed subtask T313405: Migrate remaining tools off Gridengine as Resolved.
taavi updated the task description. (Show Details)Mar 14 2024, 10:32 AM
gerritbot added a comment.Mar 14 2024, 10:33 AM

Change 1010517 merged by jenkins-bot:

[labs/toollabs@master] Remove jobutils binary package

https://gerrit.wikimedia.org/r/1010517

gerritbot added a comment.Mar 14 2024, 10:33 AM

Change 1010518 merged by jenkins-bot:

[labs/toollabs@master] misctools: Remove oge-crontab script

https://gerrit.wikimedia.org/r/1010518

taavi changed the task status from Stalled to In Progress.Mar 14 2024, 10:55 AM
taavi moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 07) board.
Stashbot added a comment.Mar 14 2024, 11:01 AM

Mentioned in SAL (#wikimedia-cloud) [2024-03-14T11:01:15Z] <taavi> disable grid access for remaining tools still running on the grid T314664

taavi updated the task description. (Show Details)Mar 14 2024, 11:01 AM
Stashbot added a comment.Mar 14 2024, 11:02 AM

Mentioned in SAL (#wikimedia-cloud) [2024-03-14T11:02:45Z] <taavi> stop grid related VMs T314664

taavi updated the task description. (Show Details)Mar 14 2024, 11:02 AM
gerritbot added a comment.Mar 14 2024, 11:03 AM

Change 1010503 merged by Majavah:

[operations/puppet@production] P:toolforge::proxy: drop grid engine dynamicproxy support

https://gerrit.wikimedia.org/r/1010503

taavi updated the task description. (Show Details)Mar 14 2024, 11:08 AM
CodeReviewBot added a comment.Mar 14 2024, 11:08 AM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/disable-tool/-/merge_requests/18

Drop Grid Engine support

taavi updated the task description. (Show Details)Mar 14 2024, 11:10 AM
gerritbot added a comment.Mar 14 2024, 11:12 AM

Change 1010892 merged by Majavah:

[operations/puppet@production] Remove Toolforge grid engine

https://gerrit.wikimedia.org/r/1010892

taavi closed subtask T359934: [infra] Archive grid engine related infrastructure tools as Resolved.Mar 14 2024, 11:17 AM
taavi updated the task description. (Show Details)
taavi updated the task description. (Show Details)Mar 14 2024, 12:20 PM
taavi updated the task description. (Show Details)Mar 14 2024, 5:28 PM
gerritbot added a comment.Mar 14 2024, 5:45 PM

Change 1010504 merged by Majavah:

[operations/puppet@production] dynamicproxy: cleanup after removing toolforge support

https://gerrit.wikimedia.org/r/1010504

greg awarded a token.Mar 14 2024, 11:37 PM
greg rescinded a token.
greg awarded a token.
Stashbot added a comment.Mar 18 2024, 9:27 AM

Mentioned in SAL (#wikimedia-cloud) [2024-03-18T09:27:32Z] <taavi> deleted shutdown grid engine VMs T314664

taavi updated the task description. (Show Details)Mar 18 2024, 9:30 AM
taavi updated the task description. (Show Details)
gerritbot added a comment.Mar 18 2024, 10:47 AM

Change 1010520 merged by jenkins-bot:

[cloud/wmcs-cookbooks@main] Remove Grid Engine support

https://gerrit.wikimedia.org/r/1010520

taavi updated the task description. (Show Details)Mar 18 2024, 10:47 AM
jenkins-bot mentioned this in rCCKBd888e8402291: Remove Grid Engine support.Mar 18 2024, 10:55 AM
taavi updated the task description. (Show Details)Mar 18 2024, 11:11 AM
CodeReviewBot added a comment.Mar 18 2024, 1:58 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/tools-webservice/-/merge_requests/31

Remove grid engine support

CodeReviewBot added a comment.Mar 18 2024, 2:04 PM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/tools-webservice/-/merge_requests/32

Tag 0.103.5

CodeReviewBot added a comment.Mar 18 2024, 2:32 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/tools-webservice/-/merge_requests/32

Tag 0.103.5

gerritbot added a comment.Mar 18 2024, 2:42 PM

Change 1012390 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge: move webservice CLI to the CLI profile

https://gerrit.wikimedia.org/r/1012390

taavi updated the task description. (Show Details)Mar 18 2024, 2:46 PM
gerritbot added a comment.Mar 19 2024, 10:49 AM

Change 1012390 merged by Majavah:

[operations/puppet@production] P:toolforge: move webservice CLI to the CLI profile

https://gerrit.wikimedia.org/r/1012390

taavi updated the task description. (Show Details)Mar 20 2024, 4:02 PM
hoshimi unsubscribed.Mar 20 2024, 4:47 PM
taavi added a parent task: T361223: Upgrade Toolforge front proxies to Bookworm.Mar 28 2024, 1:18 PM
fnegri moved this task from Backlog to In progress on the cloud-services-team (FY2023/2024-Q3-Q4) board.Mar 28 2024, 2:46 PM
dcaro edited projects, added Toolforge (Toolforge iteration 08); removed Toolforge (Toolforge iteration 07).Apr 3 2024, 4:15 PM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 08) board.
gerritbot added a comment.Apr 15 2024, 11:47 AM

Change #1019732 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] hieradata: Drop defusedxml dependency from cloudcumins

https://gerrit.wikimedia.org/r/1019732

gerritbot added a comment.Apr 15 2024, 11:51 AM

Change #1019732 merged by Majavah:

[operations/puppet@production] hieradata: Drop defusedxml dependency from cloudcumins

https://gerrit.wikimedia.org/r/1019732

dcaro edited projects, added Toolforge (Toolforge iteration 09); removed Toolforge (Toolforge iteration 08).Apr 17 2024, 7:48 AM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 09) board.
dcaro changed the task status from In Progress to Stalled.Apr 30 2024, 1:27 PM
dcaro moved this task from In Progress to Blocked/Paused on the Toolforge (Toolforge iteration 09) board.
dcaro edited projects, added Toolforge (Toolforge iteration 10); removed Toolforge (Toolforge iteration 09).May 22 2024, 4:40 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 10) board.
Maintenance_bot removed a project: Patch-For-Review.May 22 2024, 5:31 PM
dcaro edited projects, added Toolforge (Toolforge iteration 11); removed Toolforge (Toolforge iteration 10).Jun 4 2024, 2:55 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 11) board.
fnegri removed taavi as the assignee of this task.Jun 28 2024, 12:55 PM
dcaro edited projects, added Toolforge (Toolforge iteration 12); removed Toolforge (Toolforge iteration 11).Jul 2 2024, 2:01 PM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 12) board.
dcaro claimed this task.Jul 16 2024, 1:39 PM
dcaro edited projects, added Toolforge (Toolforge iteration 13); removed Toolforge (Toolforge iteration 12).Jul 17 2024, 11:22 AM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 13) board.
dcaro edited projects, added Toolforge (Toolforge iteration 14); removed Toolforge (Toolforge iteration 13).Aug 5 2024, 7:39 AM
dcaro moved this task from Next Up to Blocked/Paused on the Toolforge (Toolforge iteration 14) board.
fnegri edited projects, added cloud-services-team (FY2024/2025-Q1-Q2); removed cloud-services-team (FY2023/2024-Q3-Q4).Mon, Aug 19, 9:18 AM
fnegri moved this task from Backlog to In progress on the cloud-services-team (FY2024/2025-Q1-Q2) board.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits