Detect UTF-8 or UTF-16 BOM in a Stream using C#

Taswar Bhatti October 31, 2013 No Comments

Was detecting a file stream if it was Unicode encoded or not, so though I would share the code. Let say you an xml file that you need to detect if it has the Unicode BOM in the file. If you wish to know more about BOM look it up at wikipedia

//open the helloworld.xml file

Stream fs = new FileStream("helloworld.xml", FileMode.Open);

byte[] bits = new byte[3];
fs.Read(bits, 0, 3);

// UTF8 BOM is like 0xEF,0xBB,0xBF
if (bits[0] == 0xEF && bits[1] == 0xBB && bits[2] == 0xBF)
{
  //utf8 do something
}
//UTF16 BOM is like 0xFF, 0xFE
if (bits[0] == 0xFF && bits[1] == 0xFE)
{
  //utf16 do something
}

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

//open the helloworld.xml file

Stream fs = new FileStream("helloworld.xml", FileMode.Open);

byte[] bits = new byte[3];

fs.Read(bits, 0, 3);

// UTF8 BOM is like 0xEF,0xBB,0xBF

if (bits[0] == 0xEF && bits[1] == 0xBB && bits[2] == 0xBF)

{

//utf8 do something

}

//UTF16 BOM is like 0xFF, 0xFE

if (bits[0] == 0xFF && bits[1] == 0xFE)

{

//utf16 do something

}

Hope that […]

.NET, C#

bom, C#, csharp, dotnet, unicode

C# var keyword misconceptions

Taswar Bhatti October 22, 2013 No Comments

Lots of developers confuse the var keyword in C# with JavaScript. The var keyword was introduced in C# 3.0, and it is basically implicitly defined but is statically defined, var are resolved at compile time not at run-time. The confusion is there also a var keyword in JavaScript, but in JavaScript var is dynamically defined. […]

.NET

csharp, dotnet

C# detect inuktitut characters Canadian Aboriginal Syllabics

Taswar Bhatti November 6, 2012 No Comments

Here is a quick way to detect if a text is in Canadian Aboriginal Syllabic in C#. It is just an extension method that would detect if your string is in that range by using regex.

  public static bool IsInuktitut(this string input)
        {
            if (string.IsNullOrEmpty(input))
            {
                return false;
            }
            //http://msdn.microsoft.com/en-us/library/20bw873z.aspx
            //look at section  Supported Named Blocks
            const string pattern = @"\p{IsUnifiedCanadianAboriginalSyllabics}";

            Match match = Regex.Match(input, pattern);

            return match.Success;                    
        }

1

2

3

4

5

6

7

8

9

10

11

12

13

14

public static bool IsInuktitut(this string input)

{

if (string.IsNullOrEmpty(input))

{

return false;

}

//http://msdn.microsoft.com/en-us/library/20bw873z.aspx

//look at section Supported Named Blocks

const string pattern = @"\p{IsUnifiedCanadianAboriginalSyllabics}";

Match match = Regex.Match(input, pattern);

return match.Success;

}

Enjoy.

.NET

C#, chsarp, dotnet

Detect UTF-8 or UTF-16 BOM in a Stream using C#

C# var keyword misconceptions

C# detect inuktitut characters Canadian Aboriginal Syllabics

Opinions are my own and not the views of my employer

LinkedIn

My Book

Archives