Splitting and Joining Strings to Translate Morse Code 📇

The Julia Geek — Sat, 17 Dec 2022 08:36:29 +0000

Splitting and joining strings are two prominent actions in working on textual data. A good example of training these two concepts is to translating Morse codes. For this, we can create a Morse code dictionary like the following one:

codes = Dict(
  ".-"=>"A","-..."=>"B", "-.-."=>"C", "-.."=>"D", "."=>"E", "..-."=>"F", "--."=>"G",
  "...."=>"H", ".."=>"I", ".---"=>"J", "-.-"=>"K", ".-.."=>"L", "--"=>"M", "-."=>"N",
  "---"=>"O", ".--."=>"P", "--.-"=>"Q", ".-."=>"R", "..."=>"S", "-"=>"T", "..-"=>"U",
  "...-"=>"V", ".--"=>"W", "-..-"=>"X", "-.--"=>"Y", "--.."=>"Z", ".----"=>"1",
  "..---"=>"2", "...--"=>"3", "....-"=>"4", "....."=>"5", "-...."=>"6", "--..."=>"7",
  "---.."=>"8", "----."=>"9", "-----"=>"0", ""=>" "
)

So I consider an arbitrary rule that letters should be distinguished by a space and words by two spaces. So I define my morse function that gets an input of type String and another of type Dict{String, String}. First, it splits the input by a space and then translates each segment using the predefined dictionary. Then at the end, I join the content of the translated codes to accomplish the message:

function morse(code::String, dictionary::Dict{String, String})
  splitted = split(code, " ")
  letters = get.(Ref(dictionary), splitted, nothing)
  join(letters)
end

Now I'm ready to use the function:

morse(
  "..  .-.. --- ...- .  .--- ..- .-.. .. .-",
  codes
)

# "I LOVE JULIA"

But you know that Morse codes can also be used to deliver critical messages to the world. Then, do you want to try the translation of the following morse code?

morse(
  ".-- --- -- .- -.  .-.. .. ..-. .  ..-. .-. . . -.. --- --",
  codes
)

Cheers 🍻

How to port the Huggingface🤗 into Julia using PyCall?

The Julia Geek — Fri, 02 Dec 2022 18:26:07 +0000

Ready for a fast and concise delicious Julia thing? Read to the end, you'll be surprised.
First of all, I should mention that you can port any python package into Julia with zero overhead! This means you won't face performance reduction at all!

First, import the PyCall and connect it into an executable Python (I go for python3.10 since the huggingface🤗 isn't available for 3.11 so far):

julia> using PyCall

julia> ENV["PYTHON"] = raw"C:\Users\<USER>\AppData\Local\Programs\Python\Python310\python.exe";

julia> using Pkg

julia> Pkg.build("PyCall")

After a successful build, exit from the Julia and re-run it. Then check your python environment is changed successfully:

julia> PyCall.python
"C:\\Users\\<USER>\\AppData\\Local\\Programs\\Python\\Python310\\python.exe"

Good! I'm on Python3.10 now. Then, open cmd and install the huggingface on the same python path via pip install transformers[torch]. Then start a fresh Julia session and continue:

julia> using PyCall

julia> ts = pyimport("transformers");

julia> gen = ts.pipeline(task="text-generation")

This leads to downloading the requirements (~550MB). Then let's get a text generator:

julia> gen("Hello from Julia, Julia is a lovely programming language that is fast as C in many cases, and readable as Python in everycases.")
Setting `pad_token_id` to `eos_token_id`:50256 for open-end generation.
1-element Vector{Dict{Any, Any}}:
 Dict("generated_text" => "Hello from Julia, Julia is a lovely programming language that is fast as C in many cases, and readable as Python in everycases. Julia is a great way of creating beautiful applications and helping you write beautiful code, and I love using it everyday!")

Look how beautiful it continued my sentence:

"Julia is a great way of creating beautiful applications and helping you write beautiful code, and I love using it everyday!"

Yes OF COURSE I LOVE USING IT EVERYDAY god damn ya 😍😂
As you can see, we are good to continue further! Cheers 🍻

🟢🔴🟣 JuliaGeeks

Julia Community 🟣: The Julia Geek

Splitting and Joining Strings to Translate Morse Code 📇

How to port the Huggingface🤗 into Julia using PyCall?