Questions tagged [encoding]
The fine art of converting letters into numbers. ASCII, ISO Latin-1, Unicode, EBCDIC… There are dozens of currently used encodings and converting between them is now a witch craft.
764
questions
433
votes
19
answers
699k
views
How to encode base64 via command line in macOS/OS X?
Is there a terminal command in macOS/OS X which will base64 encode a file or stdin?
- 9,797
212
votes
9
answers
514k
views
Change default code page of Windows console to UTF-8
Currently I'm running Windows 7 x64 and usually I want all console tools to work with UTF-8 rather than with default code page 850.
Running chcp 65001 in the command prompt prior to use of any tools ...
- 2,426
155
votes
3
answers
20k
views
How and why is this string of text a fork bomb?
Found on a random chan board:
echo "I<RA('1E<W3t`rYWdl&r()(Y29j&r{,3Rl7Ig}&r{,T31wo});r`26<F]F;==" | uudecode
Somehow running this this results in an infinitely spawning process ...
- 4,762
153
votes
2
answers
229k
views
How do I change the character encoding for a webpage in Chrome?
Google Chrome, like almost every web browser in recent memory, used to have an option to change the character encoding for the webpage being viewed by going to Menu › Tools › Encoding (or some similar ...
- 1,632
125
votes
7
answers
127k
views
In ffmpeg, how to delay only the audio of a .mp4 video without converting the audio?
In my .mp4 file the audio delay is -3840 ms. I synced it in KMplayer, and I don't want to use MKVGUI to make a .mkv file. I just need to delay the audio by 3840 ms, everything else should be left ...
- 1,251
98
votes
7
answers
16k
views
Why are special characters such as "carriage return" represented as "^M"?
Why is ^M used to represent a carriage return in VIM and other contexts?
My guess is that M is the 13th letter of the Latin alphabet and a carriage return is \x0D or decimal 13. Is this the reason? ...
- 11.5k
92
votes
11
answers
180k
views
How to auto detect text file encoding?
There are many plain text files which were encoded in variant charsets.
I want to convert them all to UTF-8, but before running iconv, I need to know its original encoding. Most browsers have an ...
- 18.4k
65
votes
14
answers
126k
views
Batch convert encoding in files
How can I batch-convert files in a directory for their encoding (e.g. ANSI → UTF-8) with a command or tool?
For single files, an editor helps, but how can I do the mass files job?
- 1,102
64
votes
3
answers
144k
views
How to encode audio with Opus codec?
The Opus audio codec looks like the best codec so far for compressing audio. It has recently become supported in the latest ffmpeg and VLC players. However, there is no documentation I can find on how ...
- 1,017
52
votes
1
answer
72k
views
Check the character encoding of a given page in Chrome
Character encoding of an HTML document is determined by looking at various things (encoding in Content-Type header, meta elements, BOMs in data, etc.)
In Chrome (56), is there a way to view the ...
- 10.9k
51
votes
3
answers
50k
views
How can I convert from hex to base64?
Can anyone recommend a straightforward way/tool to convert hex to base64?
I'm using Linux and OS X.
- 643
50
votes
5
answers
42k
views
How can I change the default encoding type Thunderbird uses when composing a new email?
Whenever I compose a new email message in Thunderbird, it defaults to the Western (ISO-8859-1) encoding, and I have to manually change it to UTF-8 every time.
How do I change the default?
- 6,121
44
votes
3
answers
138k
views
Sublime Text 2 - Encoding UTF-8
How do I change the file encoding in Sublime Text 2?
How do I change character encoding of a text file in OpenOffice.org writer?
http://www.sublimetext.com/forum/viewtopic.php?f=4&t=3541
- 541
43
votes
15
answers
71k
views
How to decompress a ZIP file with specified file/directory name character encoding?
I got ZIP file(s), which contains files, which filenames are in some encoding. Let's say I know encoding of those filenames, but I still dont know how to properly decompress them.
Here is example ...
- 531
40
votes
2
answers
40k
views
Weird characters (´╗┐) at the start of a batch file [duplicate]
I am working with batch files in Windows, using both Notepad, and Notepad++. When I run the batch files, which all start with @echo off, I see the first line (when running on two separate machines) ...
- 24.4k
39
votes
6
answers
46k
views
́╗┐' is not recognized as an internal or external command
When executing certain files (mainly batch) using PsExec I get these weird ́╗┐' symbols before my command.
My initial thought was, that I were using wrong encoding, but after checking, I realized that ...
user187509
32
votes
3
answers
33k
views
How to switch back text encoding to UTF-8 with emacs?
Suddenly some of my text files, I'm editing with Emacs had changed and special characters were shown in a strange way, e. g.
\344 instead of ä
\374 instead of ü
... and so on.
In another file I now ...
- 1,878
32
votes
1
answer
36k
views
What is this '°͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌' strange character?
I saw this °͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌͌ strange character online. I also noted that:
It needs 26 backspaces to delete but behaves like one character when selecting.
It is drawn vertically covering ...
- 1,555
31
votes
1
answer
32k
views
ffmpeg - How to copy|extract encoding settings from existing media file?
I wished to be able do this multiple times now so I ask.
If I have an existing video or audio file, ffmpeg, mplayer and other media players can detect at least some of it's "propreties" like ...
- 6,416
28
votes
6
answers
36k
views
How can I create a zip / tgz in Linux such that Windows has proper filenames?
Currently, tar -zcf arch.tgz files/* encodes filenames in UTF, so Windows users see all characters spoiled in filenames which are not english, and can do nothing with it.
zip -qq -r arch.zip files/* ...
- 3,071
27
votes
4
answers
27k
views
remove <200b> character from text file
I have a huge text file containing this string/character <200b> that I want to delete. I tried with sed but it didn't work.
sed 's/<200b>//g' file
The character never shows when I open the ...
- 373
26
votes
3
answers
61k
views
Which resize algorithm to choose for videos?
I'm using VirtualDub for encoding with those settings.
However I record my stuff in 1920x1080 and resize it down to 1280x720. Now the question: which algorithm should I choose when making a balanced ...
- 6,491
25
votes
2
answers
39k
views
How do I view a page with a different character encoding in Firefox?
I'm looking at a web page and the characters are all ASCII gibberish. I have reason to believe the web page is in Shift-JIS character encoding. So, I want to view the page in that encoding.
I'm using ...
- 828
22
votes
7
answers
51k
views
What is a good way to batch re-encode mp3 files from a higher bitrate to a lower bitrate in Windows?
I have a few thousand MP3 files and they are all of mixed bitrate.
I would like to run a program that can batch encode them all to 128 kbps. Are there any decent and free solutions for this for ...
- 249
19
votes
2
answers
17k
views
Why is encoding VP8/9 so slow compared to H.264?
Recently I wanted to try out the Webm codecs VP8 and VP9 but when I ran ffmpeg to encode a H.264 MP4 file into one of the other two codecs, I realized that the encoding is (by almost an order of ...
- 1,194
18
votes
1
answer
42k
views
Excel save behaviour of CSV file with UTF8 encoding vs UTF8-Bom encoding
My original csv files are encoded with UTF8-BOM, this is so Excel can recognise the Unicode charcters (If its just encoded with UTF8 then Excel does not recognise the unicode characters).
My issue ...
- 283
17
votes
3
answers
48k
views
Change encoding of txt file
When I write :
file file1.txt
I have this output : Little-endian UTF-16 Unicode text, with CR line terminators
Then if I write :
file file2.txt
I have : ASCII text
file2.txt is created by ...
- 317
17
votes
3
answers
26k
views
How to bulk-rename files with invalid encoding or bulk-replace invalid encoded characters?
I have a debian server and I'm hosting music for an internet radio station. I have trouble with file names and paths because a lot of files got an invalid encoding, for example:
./music/Bändname - ...
- 1,162
16
votes
1
answer
33k
views
Determining the encoding of a file on Mac OS X?
How can I determine the character encoding of plain text files (such as HTML) on Mac OS X?
- 7,547
16
votes
2
answers
75k
views
Is it possible to change the default encoding in notepad? [duplicate]
On windows 7 (x64), the default option, for saving text files in notepad is ANSI.
One can select other encoding from the combo box, however, I'd like this option to be the default.
- 765
16
votes
2
answers
12k
views
Why does Firefox disable the 'Character encoding' menu for some sites?
For some websites I noticed the Firefox's 'View/character encoding' menu is disabled, why?
Is it possible to enable it?
- 968
14
votes
1
answer
19k
views
ffmpeg: Add a New audio track to existing file
I've manually created a stereo mixdown oft some 5.1 DTS tracks. Now I would like to add the new audio track to the original movie file, without dropping the old audio tracks.
My problem appears to be ...
- 143
13
votes
4
answers
12k
views
Fix encoding of German umlauts in directories and filenames (ü = u╠ê and so on)
I have many zip-files where there are encoding errors for the German umlauts (äüöÄÜÖß). They show up in both the filename.zip as well as in the included directories and files like this:
Fünf = Fu╠ênf
...
- 131
13
votes
1
answer
876
views
EGit (Eclipse) wrongly interpreting file names with non-ASCII characters?
I recently switched to using a Git repository within Eclipse (Juno SR2), using EGit. In our project, some file names contains umlauts and other special non-ASCII-characters. On the command line, git ...
- 10.7k
11
votes
3
answers
8k
views
Finding out if a FLAC or WAVPACK audio file is NOT originally encoded from a lossy source
Is there a way of checking that the so-called FLAC or WAVPACK audio file was originally encoded from a lossless source (WAV, CDA, APE, etc.) instead of a lossy source (MP3, AAC, ATRAC, etc.)?
Say I ...
- 111
11
votes
3
answers
14k
views
How to find files with given character encoding?
I am using Windows XP. I am looking for a tool that for given directory will find all files having particular character encoding (like UTF-8). Do you know such a tool?
- 554
11
votes
3
answers
12k
views
Change Firefox default encoding for text files
Text files do not include character encoding information, so Firefox has no way of knowing which one is correct. Through the menu View → Text encoding I can select the appropriate encoding. I find ...
- 1,618
11
votes
1
answer
23k
views
Where are the other letters in this Unicode block?
Info
On the Wikipedia page, "Unicode Subscripts and Superscripts", it says in the section, Other Superscript and Subscript Characters,
Consolidated, the Unicode standard defines ... a full ...
- 319
10
votes
1
answer
5k
views
Can GNU sed (for Windows) handle Unicode? If so, is it a code-page/locale issue, or a switch?
I've been using GNU SED on and off for a couple of years now. It spins me out a bit sometimes, but it does a good job... for single-byte char sets!
I now and then notice references to GNU SED being ...
- 3,043
9
votes
2
answers
3k
views
Why does VIM show the Unicode code point and not the UTF-8 code value?
Consider this supposed line of code that I found in a PHP blog, note the quotes:
throw new Exception(“That's not a server name!”);
Those quotes are RIGHT DOUBLE QUOTATION MARK (Unicode code point: U+...
- 11.5k
9
votes
3
answers
3k
views
fixing mis-encoded Chinese in file names
I'm saddled with a bunch of files whose names are garbled beyond recognition. Even though I more or less know what those names originally contained, fixing them by hand would involve a lot of hassle, ...
- 93
9
votes
4
answers
44k
views
Is it possible to rename files in a zip archive before extracting?
I pulled a zip file from the web which was packed on a system where filenames were encoded in a format my unzip program fails to read. Perhaps the file-system does not support those weird characters, ...
- 11.4k
9
votes
4
answers
22k
views
Video encoding: How much does the video file size increase with fps?
Given that the next blockbusters of e.g. Peter Jackson (The Hobbit) and James Cameron (Avatar 2) are going to be shot with a frame rate of 48 fps (or even more) - i.e. more than the usual 24 fps - I ...
- 1,716
9
votes
2
answers
29k
views
Windows 10 terminal encoding
How can I find out the encoding of my windows 10 terminal? It doesn't display characters right.
I am trying to output unicode characters that it apparently supports but it behaves strangely when ...
- 99
9
votes
1
answer
6k
views
What does the "cutoff" option do in FFmpeg?
I am encoding some FLAC files into AAC and I came across the
-cutoff option.
I do not see this option in the documentation, however I did find it in the help
$ ffmpeg -v warning -h full | grep ...
- 1
9
votes
1
answer
10k
views
Save UTF-8 without BOM Visual Studio 2012
It seems that Visual Studio 2012 hates UTF-8 without BOM and always adds it, resulting in an empty line in PHP pages.
How can I change the encoding to UTF-8 without BOM (or at least to Unicode...)
- 361
9
votes
2
answers
26k
views
How do I view unicode characters on command prompt
I read this post on superuser on how to view UTF-8 characters on command prompt in windows. I tried the steps in the answer which were :
Start -> Run -> regedit
Go to [HKEY_LOCAL_MACHINE\...
- 2,243
9
votes
1
answer
76k
views
How to change LibreOffice default text encoding?
I want to change the default text encoding used by LibreOffice when saving a document as a Text document. Where can I find this setting?
I want it to be UTF-8 WITHOUT the BOM, which I believe is ...
- 197
9
votes
2
answers
477
views
General guidelines / workflow to convert or transfer video "professionally"?
I'm an IT "professional" who sometimes has to deal with small video conversion / video cutting projects, and I'd like to learn "the right way" to do this. Every time I search Google, there's always a ...
- 1,114
8
votes
4
answers
21k
views
File encoding not preserved after saving in Notepad++
I'm using Notepad++ for editing my PHP scripts.
However, I found a strange problem: when changing the encoding from ANSI to UTF-8 (without BOM), saving, closing, re-loading – then checking encoding: ...
- 793