I recently worked on an ETL project in Python. Among other things, the script had to process JSON files that users dropped into a specific folder.
As this was a sensitive application, it was important to validate the script by submitting fake JSON files, but also to ensure the quality of the files received.
For the fake files, I used a tool like the Faker library for Python.
In my RSS feed recently, I came across another great application that lets you create a database model from scratch, i.e. create tables one by one and create the links between them.
However, there's another option that I find really nice: you can get a visual of the tables and relationships of any existing application in a few seconds from an .sql file that you import into drawdb-app.
Let's take a quick look at how it works.
Exactly like my SQL - Formatting tool, it's always useful to have a tool in your favourites that lets you copy/paste a JSON character string and display it as a tree-view with or without code folding feature.
I use it quite regularly when I'm writing a JSON string and I want to check that there are no syntax errors (lint) or, on the other hand, and for example, when I call an API that returns JSON and I want to analyse the code received. In these cases, the collapse functionality comes in very handy.
After my article SSH - Launch a terminal on your session without having to authenticate yourself, it was obvious that, next to the ssh and scp commands, I forgot the sftp one.
In this article, we'll explore how to start a SFTP connection to a remote server; from the command line.
In the second section, we'll also learn how to configure the sftp connection to use a proxy server.
Imagine that you regularly need to connect to your Linux server: you need to launch a tool such as Putty, you need to enter your login, password, etc. and carry out various operations before you can access the terminal.
If your password isn't saved in Putty's configuration, you'll have to launch another tool like a password vault; in short, it's annoying.
In this article, we'll look at how to authenticate once and for all on the server using an SSH key.
In my previous article; Linux - Take advantage of the number of CPUs you have; start concurrent jobs, we've seen how to start jobs in parallel.
The next cool thing is to show a progression bar in your console. This has a number of advantages, including a clear view of what's been done and what's still to be done, as well as an attractive interface.
Months ago, I've found this french blog post in my RSS feeds: https://xieme-art.org/post/bash-avance-barre-de-progression/ and, just, wow!!!
Let's play with it.
In my professional activity, I've been faced with the following requirement: process each line of a CSV file and make a POST API call to upload a document.
One line of the CSV contained information that needed to be communicated to an API service, and each line corresponded to a PDF file. So if there are 1000 lines in the CSV file, I have to make 1000 API calls to upload 1000 PDFs.
I wrote my script in Linux Bash and then it was time to optimise: not just one API call at a time, but as many as possible.
Let's how we can start more than one task at a time using Linux Bash.
If you think writing unit tests in PHP is fun, stay in the room; the rest of you please leave. And then everyone leaves, including the person who asked the question.
Writing “old-fashioned” unit tests with PHPUnit is so boring that almost nobody does it.
And for some time now, https://pestphp.com/ has come along and totally changed the way things are done.
Pest is a wrapper around PhpUnit so, for instance, every command line arguments supported by PhpUnit can be used for Pest.
As you know, VSCode is highly customizable; you can install plethora of addons, change the default theme and use your preferred font.
Just take a look on the JetBrains Mono font. This is a free of charge font, for both commercial and non-commercial purposes.
In addition to the fact that it is particularly legible, making it much clearer to distinguish between an O (the letter) and a 0 (the number), between an I (upper-case I) and an l (lower-case l); JetBrains Mono font comes with nice ligature elements.
In this article, we're going to explore some tips for using Git more easily by customising the ~/.gitconfig file.
We'll create a new git undo command to abandon the last local commit.
We'll see how to share Windows Credentials manager with Linux, to have multiple credentials based on your folders structure, ...
We'll also see how to better works with branches like sorting them by commit date instead of their name, to automatically prune (remove) old branches or to force the creation of a new branch on the remote.