Skip to content

Exclude deleted jobs from usage statistics queries #640

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
pavanvidem wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Exclude deleted jobs from usage statistics queries #640

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions sources/data/usage_stats/usage_stats_2025.08.31/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,20 +4,20 @@ Needs to be run via the Galaxy Admin Stats Account

# tool usage last 5 years
```sql
\copy (SELECT DISTINCT REGEXP_REPLACE(j.tool_id, '(.*)/(.*)', '\1') AS tool_name, COUNT(*) AS count FROM job j WHERE j.create_time BETWEEN '2020-08-31' AND '2025-08-31' GROUP BY tool_name ORDER BY count DESC) TO 'tool_usage_5y_until_2025.08.31.csv' WITH CSV HEADER
\copy (SELECT DISTINCT REGEXP_REPLACE(j.tool_id, '(.*)/(.*)', '\1') AS tool_name, COUNT(*) AS count FROM job j WHERE j.create_time BETWEEN '2020-08-31' AND '2025-08-31' AND j.state != 'deleted' GROUP BY tool_name ORDER BY count DESC) TO 'tool_usage_5y_until_2025.08.31.csv' WITH CSV HEADER
```

# tool usage for ever
```sql
\copy (SELECT DISTINCT REGEXP_REPLACE(j.tool_id, '(.*)/(.*)', '\1') AS tool_name, COUNT(*) AS count FROM job j WHERE j.create_time <= '2025-08-31' GROUP BY tool_name ORDER BY count DESC) TO 'tool_usage_until_2025.08.31.csv' WITH CSV HEADER
\copy (SELECT DISTINCT REGEXP_REPLACE(j.tool_id, '(.*)/(.*)', '\1') AS tool_name, COUNT(*) AS count FROM job j WHERE j.create_time <= '2025-08-31' AND j.state != 'deleted' GROUP BY tool_name ORDER BY count DESC) TO 'tool_usage_until_2025.08.31.csv' WITH CSV HEADER
```

# tool users last 5 years
```sql
\copy (SELECT tool_name, COUNT(*) AS count FROM (SELECT DISTINCT REGEXP_REPLACE(tool_id, '(.*)/(.*)', '\1') AS tool_name, user_id FROM job WHERE create_time BETWEEN '2020-08-31' AND '2025-08-31' GROUP BY tool_name, user_id) AS subquery GROUP BY tool_name ORDER BY count DESC) TO 'tool_users_5y_until_2025.08.31.csv' WITH CSV HEADER
\copy (SELECT tool_name, COUNT(*) AS count FROM (SELECT DISTINCT REGEXP_REPLACE(tool_id, '(.*)/(.*)', '\1') AS tool_name, user_id FROM job WHERE create_time BETWEEN '2020-08-31' AND '2025-08-31' AND j.state != 'deleted' GROUP BY tool_name, user_id) AS subquery GROUP BY tool_name ORDER BY count DESC) TO 'tool_users_5y_until_2025.08.31.csv' WITH CSV HEADER
```

# tool users for ever
```sql
\copy (SELECT tool_name, COUNT(*) AS count FROM (SELECT DISTINCT REGEXP_REPLACE(tool_id, '(.*)/(.*)', '\1') AS tool_name, user_id FROM job WHERE create_time <= '2025-08-31' GROUP BY tool_name, user_id) AS subquery GROUP BY tool_name ORDER BY count DESC) TO 'tool_users_until_2025.08.31.csv' WITH CSV HEADER
```
\copy (SELECT tool_name, COUNT(*) AS count FROM (SELECT DISTINCT REGEXP_REPLACE(tool_id, '(.*)/(.*)', '\1') AS tool_name, user_id FROM job WHERE create_time <= '2025-08-31' AND j.state != 'deleted' GROUP BY tool_name, user_id) AS subquery GROUP BY tool_name ORDER BY count DESC) TO 'tool_users_until_2025.08.31.csv' WITH CSV HEADER
```
Loading