Commons:Village pump/Technical

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search

Shortcuts: COM:VP/T • COM:VPT

Welcome to the Village pump technical section
Technical discussion
Village pump/Technical
 Bug reports
 Code review
Tools
 Tools/Directory
 Idea Lab



This page is used for technical questions relating to the tools, gadgets, or other technical issues about Commons; it is distinguished from the main Village pump, which handles community-wide discussion of all kinds. The page may also be used to advertise significant discussions taking place elsewhere, such as on the talk page of a Commons policy. Recent sections with no replies for 30 days and sections tagged with {{Section resolved|1=--~~~~}} may be archived; for old discussions, see the archives; recent archives: /Archive/2023/12 /Archive/2024/01.

Please note
 
SpBot archives all sections tagged with {{Section resolved|1=~~~~}} after 1 day and sections whose most recent comment is older than 30 days.

I'm trying to add formatting parameters to Template:Userpage (e.g. for changing the background color), but having some issues. I introduced them to Template:Userpage/layout, but I gather that I need to pass them through language variants like Template:Userpage/en to get them to be usable. But when I try to add something like

|border={{{border|}}}
|background={{{background|}}}
|extra-style={{{extra-style|}}}
|file={{{file|}}}

to the English translation, it shows in previews that undefined values are interpreted as blanks rather than just ignored. How do I get around this? Best, {{u|Sdkb}}talk 19:48, 5 December 2023 (UTC)Reply[reply]

{{subst:bump}} {{u|Sdkb}}talk 23:26, 3 January 2024 (UTC)Reply[reply]

Path between categories[edit]

Do we have a tool, to show path between two categories? Juandev (talk) 16:57, 13 December 2023 (UTC)Reply[reply]

As far as I know such a tool doesn't exist, but it wouldn't be hard to make a python script to find a path between two given categories. Pere prlpz (talk) 22:11, 2 January 2024 (UTC)Reply[reply]

Upload wizard change[edit]

The upload wizard design seems to have been changed in the last day or two. Is there any possibility that whoever changed it could provide more space for answers to 2. Where did you find this work? Enter the website, the book, or another source. and 3. Enter the name of the original author of this work., both of which questions often require more than a single short sentence. By way of example, for an image I've just uploaded I'd like to give the following information for q.2 - which used to fit in the edit box before this change; now there's a single line edit box which requires both horizontal and vertical scrolling to try to make any sense of the input text:

Upper Wharfedale : being a complete account of the history, antiquities and scenery of the picturesque valley of the Wharfe, from Otley to Langstrothdale via Internet Archive - https://archive.org/details/upperwharfedaleb00speiuoft/page/n177/mode/2up

Image cropped from https://ia800905.us.archive.org/view_archive.php?archive=/9/items/upperwharfedaleb00speiuoft/upperwharfedaleb00speiuoft_jp2.zip&file=upperwharfedaleb00speiuoft_jp2%2Fupperwharfedaleb00speiuoft_0195.jp2&ext=jpg

--Tagishsimon (talk) 05:46, 14 December 2023 (UTC)Reply[reply]

@Tagishsimon: You may wish to ask this at (or see) Commons talk:WMF support for Commons/Upload Wizard Improvements. Andy Mabbett (Pigsonthewing); Talk to Andy; Andy's edits 15:22, 14 December 2023 (UTC)Reply[reply]
@Udehb-WMF. RZuo (talk) 15:32, 15 December 2023 (UTC)Reply[reply]
@Tagishsimon Do you mind translating your request into a Phabricator ticket? I'll raise the problem at the next round of talks with the designer when they get back from the holidays. Sannita (WMF) (talk) 17:23, 19 December 2023 (UTC)Reply[reply]
  • Just chiming in to add my voice that the new Upload Wizard really sucks. Too many buttons to click, too little space to put nicely formatted source info, and an apparent obsession with AI (is AI really such an issue that it needs explicit noting several times in the upload process?) --Animalparty (talk) 17:13, 14 January 2024 (UTC)Reply[reply]

Improving MP4 error message[edit]

Related to Commons:Requests_for_comment/Technical_needs_survey#Video_conversion_support, can we at least make the error message when someone tries to upload an MP4 file point to Help:Converting video? I believe the message is hosted at MediaWiki:Mwe-upwiz-upload-error-bad-filename-extension, but not sure whether it can accept links or not. {{u|Sdkb}}talk 08:12, 19 December 2023 (UTC)Reply[reply]

Does anyone familiar with the interface area know this? {{u|Sdkb}}talk 07:00, 13 January 2024 (UTC)Reply[reply]
As far as I see, it uses mw.jqueryMsg, so it can use wikitext to the extent documented at mw:Manual:Messages API#Feature support in JavaScript – a simple internal or external link should work. (However, be aware that overriding the message here on Commons has i18n implications, so maybe you should convince developers to make the change in the code / on Translatewiki.) —Tacsipacsi (talk) 10:13, 13 January 2024 (UTC)Reply[reply]
Thanks, @Tacsipacsi! Given that Help:Converting video is a local page and other wikis might decide to accept MP4s, a local message seems necessary.
The next challenge is that I'm noticing that the error message comes up for all non-accepted filenames, not just MP4s. I imagine that most users encountering the message will be trying to upload MP4s (the WMF could maybe provide data on that), but still, this makes it impossible to provide help tailored to the specific unallowed file type a user is trying to upload. And it seems there's no way to resolve that, since we can't use parser functions to check the variable? I'll make an edit request to link to both Help:Converting video and Commons:File types, but ideally the tool will be smarter in the future. {{u|Sdkb}}talk 16:05, 13 January 2024 (UTC)Reply[reply]
Edit request made here. Cheers, {{u|Sdkb}}talk 16:17, 13 January 2024 (UTC)Reply[reply]

Colors not showing up correctly on SVGs?[edit]

File in question

Hello!

I recently fulfilled a request at the Illustration Graphics Lab for a logo, but I noticed something weird when I uploaded it...

The colors are wrong! Especially the blue! It was supposed to be #0000FF, but my eyedropper tool says that the PNG rendering has #5401FF as its color, which is closer to purple! Why is that? QuickQuokka [⁠talkcontribs] 20:39, 24 December 2023 (UTC)Reply[reply]

So, I just checked it out on my phone, and it looks like it's alright at the expected color, so I think this problem may be on my end, but why though? QuickQuokka [⁠talkcontribs] 20:58, 24 December 2023 (UTC)Reply[reply]
I do not know, but here are some issues.
The SVG colorspace is sRGB.
When WMF's rasterizer converts the SVG to PNG, it does not specify the sRGB colorspace.
When the PNG is painted to the screen, there may be a colorspace conversion.
When the color picker selects a pixel, it may read the device colorspace.
Glrx (talk) 21:13, 24 December 2023 (UTC)Reply[reply]

Template for adding up the amount of files of all subcats inside a cat[edit]

Hi folks!

Is there a template that adds up the number of all files of all subcategories in one category?

Thank you! --PantheraLeo1359531 😺 (talk) 10:18, 25 December 2023 (UTC)Reply[reply]

I think I figured it out! (for all those who are interested in: https://petscan.wmflabs.org/) --PantheraLeo1359531 😺 (talk) 10:27, 25 December 2023 (UTC)Reply[reply]

SHA1 hashes[edit]

There are SHA1 hashes available in PetScan for each file from Wikimedia Commons. I suspect this is information received via API from Commons. Does MediaWiki creates hash for an upload version of the file or are these hashes for the last version of a file? Juandev (talk) 06:22, 26 December 2023 (UTC)Reply[reply]

@Juandev: MediaWiki provides a sha1 hash for each revision of a file, not just the latest revision. Xover (talk) 07:20, 26 December 2023 (UTC)Reply[reply]

Need help of someone that knows C#[edit]

I administer monthly Commons:Photo challenge for Last 8 years. The process we use is described at Commons:Photo challenge/Maintainers Manual , but to keep it short we mostly rely on 2 C# codes written a decade ago by User:Colin for automatically processing of Photo Challenge pages. The codes:

went almost unchanged since they were written and they are meant to be run on your PC in Visual Studio. This month, the codes stopped compiling for me and so far I was not able to create voting pages or score last month results. I am very familiar with dozen programing languages but I do not know C# and its external libraries management. I suspect the issue is with changing C# language standards and lack of backwards compatibility. Can someone familiar with C# can help me getting those 2 codes to run? Jarekt (talk) 04:12, 7 January 2024 (UTC)Reply[reply]

being a noobish coder, i'd throw the code into chatgpt and ask it to rewrite a python version? or a language that you use. :p RZuo (talk) 10:26, 7 January 2024 (UTC)Reply[reply]
I've responded to Jarekt on another page. I'll have a look see what the problem is. -- Colin (talk) 19:01, 7 January 2024 (UTC)Reply[reply]

Which file has the largest number of associated timedtext pages[edit]

i'm wondering how mediaplayer's selection menu for cc looks like if there're a hundred languages to choose from. RZuo (talk) 10:47, 7 January 2024 (UTC)Reply[reply]

@RZuo: The clear winners are File:Sit-in Against Racial Injustice, Downtown Indianapolis (2020-06-06).webm with impressive 201 languages (and only seven seconds) and File:Silence.ogg with 186 languages (and 18 seconds). —Tacsipacsi (talk) 00:52, 10 January 2024 (UTC)Reply[reply]

Searching on "Highgate tube station" - pics of Archway tube station also appear![edit]

Searching on "Highgate tube station" (a station on the London Underground system) also brings up pictures of the nearby "Archway tube station". A glitch in the system? Best, Sunil060902 (talk) 13:41, 8 January 2024 (UTC).Reply[reply]

@Sunil060902: Assuming you're using Special:MediaSearch and typing without quotation marks, I see similar results: after about 50 pictures of Highgate station I start getting photos of Archway as well. I think this is because those photos have structured data indicating that they depict Archway tube station (Q636351), and that Wikidata item has aliases that include "Highgate tube station" (because that's what Archway used to be called). So I think this is intended behaviour: Special:MediaSearch thinks that by "Highgate tube station" you might mean that one that used to be called "Highgate" and returns files for that as well as for the current Highgate. If you want a search that doesn't use Wikidata (and generally tries less hard to be helpful) you can use Special:Search instead. And for cases like this, just using the category Category:Highgate tube station is likely to give even fewer bad results. --bjh21 (talk) 14:13, 8 January 2024 (UTC)Reply[reply]
Hi bjh21, thanks for that. Seems to work, and I do remember the history re. naming. But just to let you know I actually was using quotes in the MediaSearch! I noticed it also when searching specifically for my own pictures of Highgate - namely Sunil060902 "Highgate tube station".
https://commons.wikimedia.org/w/index.php?search=Sunil060902+%22Highgate+tube+station%22&title=Special:MediaSearch&go=Go&type=image
Twelve results, five of which are pictures of Archway. At least those are my own! Best, Sunil060902 (talk) 14:27, 8 January 2024 (UTC).Reply[reply]
@Sunil060902: Yes, since the alias in Wikidata is precisely "Highgate tube station" the quotation marks aren't enough to exclude it. I mentioned not using them because when I started that reply I thought the cause would be stray uses of "Highgate" in descriptions like on File:Archway station (3749849371).jpg, but that turned out not to be relevant. --bjh21 (talk) 14:56, 8 January 2024 (UTC)Reply[reply]

Tech News: 2024-02[edit]

MediaWiki message delivery 01:17, 9 January 2024 (UTC)Reply[reply]

Structure of the upload path of files[edit]

Hi. I was checking the strcture of the url to files here on Commons. Someone pointed out to me that to create a thumbnail in an excel data sheet you need that, not the page url (I trusted that assetion, I haven't checked), so they asked me how to extract it.

That's how (after so many years) I have noticed that the url to the file is not "direct", and there is also a short string between the first part ''https://upload.wikimedia.org/wikipedia/commons/'' and the actual file name:

  • ''https://upload.wikimedia.org/wikipedia/commons/'' f/f2 /Ricci_di_castagno.jpg / [4]
  • ''https://upload.wikimedia.org/wikipedia/commons/'' 2/22 /"Pizza"_ai_funghi.jpg / [5]
  • ''https://upload.wikimedia.org/wikipedia/commons/'' 0/05 /-_Garzetta_-_Valli_di_Comacchio.jpg [6]

Can someone tell me something about that?

  • First question: what is it about? Soemone told me that maybe it's related to the distrtibuted server where the file is actually stored.
  • Second question: so far I only find it in the format X/XY, where the first number or letter seems to be always identical to the second number or letter (also a/ac, c/c7, 6/65...). Is this correct? What's the "physical" meaning of that, if so?
  • Third question: can it be predicted from the file name or there is no way to do? I suppose it can't.

Thanks in advance. Alexmar983 (talk) 20:57, 9 January 2024 (UTC)Reply[reply]

1. Probably. Hashing evenly distributes files to servers. First number is prefix of the second.
2. The file URL numbers are generated from an MD5 hash of the filename. That algorithm should be viewed as opaque: WMF should be able to change it later, and if it does, then the concrete links will no longer work.
3. Yes, it can be predicted, but it is better to use other methods. Special:Filepath will find the image through a redirect. The MediaWiki API will give the filename.
Glrx (talk) 22:00, 9 January 2024 (UTC)Reply[reply]

video2commons cannot be accessed normally[edit]

This is an auxiliary tool that can parse videos. Recently, it was found that it could not be opened normally, and it was suspected that the website was out of service. Fumikas Sagisavas (talk) 08:36, 11 January 2024 (UTC)Reply[reply]

@Fumikas Sagisavas i just used it to upload a vimeo video.
but if you're uploading youtube, then it doesnt work at the moment. other than that it should be working. RZuo (talk) 09:14, 11 January 2024 (UTC)Reply[reply]

rename without redirect[edit]

Template:Rename does not say how this is done (from a script).

I have a few thousand files to rename, recently uploaded, with an errorneous filename.

Thx Nowakki (talk) 15:37, 12 January 2024 (UTC)Reply[reply]

@Nowakki: Hi. There is no special parameter in the template to specify such requests, you can ask for it in the request reason (|reason=), the filemover won't refuse if the uploads are recent and unused. Thanks! -- CptViraj (talk) 18:15, 12 January 2024 (UTC)Reply[reply]
50,000+ files. At some point the approval will become an automatic operation. I just leave it to them to auto-approve with no redirect? Nowakki (talk) 18:26, 12 January 2024 (UTC)Reply[reply]
If you want to have 50,000+ files renamed, you should probably write at Commons:Bots/Work requests instead of flooding the backlog category. There you can explain what exactly you want, including that you don’t want redirects. —Tacsipacsi (talk) 09:25, 13 January 2024 (UTC)Reply[reply]
I already have the bot. Nowakki (talk) 10:23, 13 January 2024 (UTC)Reply[reply]

Image preview is not displayed[edit]

I have observed repeatedly that no preview image of an SVG file is shown although the SVG file seems to be valid. What is the reason for this? Some examples: File:Asiatischer Monat 2023 Goldmedaille.svg, File:Asiatischer Monat 2023 Silbermedaille.svg, File:Asiatischer Monat 2023 Bronzemedaille.svg.

Thanks for any suggestions. --Furfur Diskussion 18:01, 12 January 2024 (UTC)Reply[reply]

tiff files wasting space[edit]

There are 98,000 tiff files of Sanborn Fire Insurance Maps on commons, each 140-150MB in size.

With LZW compression such a file typically shrinks by 100MB with a runtime of the tiffcp command on a 3.5ghz cpu at 2 seconds.

in total 10TB of wasted space. Nowakki (talk) 15:34, 13 January 2024 (UTC)Reply[reply]

The files could be renewed with compressed file versions, but I do not know how the uncompressed files could be deleted to make the disk space free --PantheraLeo1359531 😺 (talk) 12:28, 15 January 2024 (UTC)Reply[reply]
The files can be compressed on the server. No need to upload them again. That would be stupid. Nowakki (talk) 12:48, 15 January 2024 (UTC)Reply[reply]
That can only be done by system administrators, so the right place to discuss this is https://phabricator.wikimedia.org/. Yann (talk) 13:01, 15 January 2024 (UTC)Reply[reply]
Actually I think system administrators read the technical forum. Or they have lieutenants who do.
In a properly run organization this would be a minor problem and would have been solved years ago. It is my current understanding that commons celebrates a kind of post office mediocrity. Nobody volunteers to be staff. They volunteer to be volunteers. Nowakki (talk) 13:07, 15 January 2024 (UTC)Reply[reply]
Anyway, this isn't even the worst. I have been here for 2 weeks or so and already had the pleasure of going against a crust of bureaucracy on a proposal to rename Sanborn map files.
I have learned that it is policy to enshrine whatever bad name choice was made by the original uploader. Although, given that names of mass uploads do not have to be approved, i am fairly sure that there also exists a policy that bad names can always be changed at a later time.
Spent 1.5 weeks building an sqlite database and a bunch of scripts to try and rectify the mess. Spent another week trying to convince what are probably mid level staffers of the benefits. I did everything right, what i got was negative help. The whole thing could have been over with last week. Now it will probably be done a few years down the road. Nowakki (talk) 14:14, 15 January 2024 (UTC)Reply[reply]
  • 10TB of 'wasted space' is just how much, in terms of the project's resources? Andy Dingley (talk) 14:54, 15 January 2024 (UTC)Reply[reply]
    Don't know. Probably more than 1%, less than 3%. Depends on a lot of factors in the end. Commons doesn't rent Icelandic deep cave long term storage for premium dollar amounts? This is only files from one uploader, not all tiffs on the server. Waste in one place encourages waste in other places, if 10TB is not much then 50TB would only be a small problem. How often is the data replicated and backed up. And so on...
    Seems like an interesting article could be written on the subject. I would read. Nowakki (talk) 15:14, 15 January 2024 (UTC)Reply[reply]
    @Andy Dingley I did some math.
    Assume 20 Watt to run 1 CPU core and the hard disk on the conversion job. The process generates 50MB of free space per second.
    That is 1TB in 20,000 seconds at 400 kilowattseconds. Assuming 10 cents per kilowatthour that would mean a 1TB hard disk can be generated effortlessly out of thin air for the price of 1.1 cents. Nowakki (talk) 17:44, 15 January 2024 (UTC)Reply[reply]

Tech News: 2024-03[edit]

MediaWiki message delivery 00:10, 16 January 2024 (UTC)Reply[reply]

Total Daily Image Views[edit]

Do we have a tool that will show the totals for image views similar to the old d.o.s. syntax "*common_image_title.jpg" that poll from the viewer logs? The site wmcloud.org does not allow wildcards * in the lookup and seems to only be able to handle one request at a time. [GLAMorous] on toolforge might be configurable to do it, anyone have any suggestions or experience here? --Don (talk) 21:07, 17 January 2024 (UTC)Reply[reply]

do you mean something like https://glamtools.toolforge.org/glamorgan.html ? RZuo (talk) 13:53, 18 January 2024 (UTC)Reply[reply]
Hi thank you for the reply, I am familiar with Glam and it does not seem to be configurable to use a wild card * in the search and limits the scope of the search to category by image. What I am looking for is total number of views of ALL images in a category. --Don (talk) 22:25, 18 January 2024 (UTC)Reply[reply]
i dont get how this tool doesnt fulfil your wish. if you try the demo, it gives
76 files in category tree.
37 files were viewed, out of 44 used.
235 pages on 66 wikis use those files.
243,106 file views in 2016-01. (= total number of views of ALL images in a category? albeit limited to only a given month.)
Data for 80 pages could not be loaded from the WMF pageview API (404 error). RZuo (talk) 23:00, 18 January 2024 (UTC)Reply[reply]

MoreMenu[edit]

I keep on seeing this weird error on the right top of my system: "Uncaught Error: module already implemented: ext.gadget.MoreMenu". Is this only me? ─ The Aafī (talk) 11:03, 18 January 2024 (UTC)Reply[reply]

Upload Wizard issue with file extensions[edit]

The Upload Wizard is giving uploaders misleading information about why a given image title cannot be accepted. If you try to upload a file with the image extension included by mistake, the Wizard will warn you to Please choose a different, descriptive title (more info).

Clicking "more info" brings up a box that says this:

There was an error in your submission. The file name you were trying to upload has been blacklisted because it is very common, uninformative, or spelled in ALLCAPS. Please go back and choose a better file name.  When uploading files to Wikimedia Commons, please use a file name that describes the content of the image or media file you're uploading and is sufficiently distinctive that no-one else is likely to pick the same name by accident.
Examples of good file names:
Nodnol skyline from Nodnol City Hall - Aug 2022.jpg
1875 Meeting of Settlers at Falconer Bay, New Nodland.jpg
Pseudohedron with no vertex visible from center.png
Examples of bad file names:
Image01.png
Joe.jpg
DSC00001.JPG
Foo.svg.png
30996951316264l.jpg
PSEUDOHEDRON WITH NO VERTEX VISIBLE FROM CENTER.png
For more information, please see Commons:First steps/Upload form. If you have a good reason for uploading a file with this name, or if you receive this message when attempting to upload a new version of an existing file, please let us know at Commons:Administrators' noticeboard or directly at MediaWiki talk:Titleblacklist.  Be sure to specify the exact name of the file you are trying to upload. Thank you.}}

This information is unhelpful. The problem with the image is that it includes an image description, not that it isn't descriptive enough. Schierbecker (talk) 00:38, 19 January 2024 (UTC)Reply[reply]

Request feedback[edit]

Hello, I look forward to seeking your feedback on this script, which easily helps copy decoded links of pages/files in one click. It does not, however, currently work on revisions/pages that come through Special:MobileDiff but it perfectly works elsewhere. ─ The Aafī (talk) 07:59, 19 January 2024 (UTC)Reply[reply]

great script. exactly the same as what i also wished for https://commons.wikimedia.org/w/index.php?title=Commons:Idea_Lab&oldid=836459487#Big_button_/_keyboard_shortcut_to_copy_pagename_to_clipboard_(add_links) .
i already forked 1 for myself User:RZuo/PagenameCopier.js. for me i dont care about aesthetics so much. i just need the button to be big, really BIG. it'd be even better if there's a keyboard shortcut. :D
i'd also replace the svg with 1 hosted on commons. i found and used File:Copy-outlined-circular-button.svg because it looks unique and stands out from everything else. RZuo (talk) 09:17, 19 January 2024 (UTC)Reply[reply]
Thanks for the compliment @RZuo. I'd change the image and also see if I can fit in what you have been looking for. ─ The Aafī on Mobile (talk) 11:20, 19 January 2024 (UTC)Reply[reply]
If you want to copy just the wiki links (for interwiki linking purposes), I've a solution for that. I'll do some tweaks later in the day. ─ The Aafī on Mobile (talk) 11:31, 19 January 2024 (UTC)Reply[reply]
I did some tweaks and changed the icon with this one from Commons. ─ The Aafī (talk) 18:57, 19 January 2024 (UTC)Reply[reply]

Vertical titles on mobile[edit]

The titles of sections appear vertical on mobile devices.

Since December 2023 I've been experiencing the titles of sections in mobile to be vertical. I am also experiencing this on Wikipedia and other Wikimedia websites. Does anyone else experience this while using a mobile device? I notice that it is very screen size sensitive, on smaller devices I see this, but on tablet computers and laptops the titles appear different. --Donald Trung 『徵國單』 (No Fake News 💬) (WikiProject Numismatics 💴) (Articles 📚) 23:44, 19 January 2024 (UTC)Reply[reply]

Is CropTool Working?[edit]

I have tried starting CropTool to modify images. It stopped working about 2024-01-19. I use it frequently and have tried to start it with several different images.

I just tried it again and got the following message:

Wikimedia Toolforge Error[edit]

This Grid Engine web service cannot be reached. Please contact a maintainer of this tool.

Tool maintainers can find more details from the documentation on Wikitech.

I have spent over an hour trying to figure out where to post my problem. This was my best guess. I am too old to figure out who the maintainer is. I do not have a talk page on Wikimedia. User-duck (talk) 01:09, 22 January 2024 (UTC)Reply[reply]