Oldest film in existence which was taken in Leeds 132 years ago is remastered into a stunning 4K video using artificial intelligence
- Roundhay Garden Scene was shot in Leeds 132 years ago and shows four people walking around in a circle
- Three-second footage is thought to be the oldest film ever, shot by the inventor of an early motion camera
- Engineer has used sophisticated AI software to bump the original 20 frames up to a smooth 250 frame video
Artificial intelligence has been used to upscale the oldest film in existence, recorded in a garden in Leeds 132 years ago.
Roundhay Garden Scene is a short film shot on October 14, 1888, showing four people strolling around the garden of Oakwood Grange in the Leeds suburb of Roundhay.
The original black and white video, recorded by French inventor Louis Le Prince, is only 1.66 seconds long and comprises just 20 frames.
But YouTuber Denis Shiryaev has posted a new version of the legendary video on his site, which is now in 4K quality at around 250 frames per second.
Using a neural network to fill in the blanks and artificially generate additional frames, Shiryaev has been able to upscale the 20 original frames to give a much smoother sense of motion.
Artificial colouring and face restoration techniques have also made the Victorian-era video seem like it was shot with modern camera equipment. Today we will time travel to the year 1888 in Leeds, England,' Mr Shiryaev says in his video, posted to YouTube.
'Maybe you have seen this GIF or poor quality video, I have decided to apply the full force of modern machine learning algorithms to improve the original quality.'
The four subjects in the video, who are friends and family of Le Prince, are purposely walking in a circle to keep within the area framed by Le Prince's single lens camera, which he invented and made himself.
But the problem with this video is that the original footage was probably around only 12 frames per second, Shiryaev estimates, which is extremely low and only leaves 20 frames to work with.
Firstly, Shiryaev downloaded the 20 positive frames for free from the British Science Museum's webpage.
The Science Museum had created photographic glass plate copies in the 1930s from the original paper negatives created by Le Prince.
Then, Shiryaev divided the 20 frames up and aligned them in the software so the subjects were in a consistent position across the frames.
He then added a stabilisation algorithm and applied an aggressive face restoration neural network to add more details to the individual faces in the frames.
The three-second short silent film was recorded by French inventor Louis Le Prince, who made an early motion picture camera
Shot from the film before the colourisation was added. Shiryaev has been able to upscale the 20 original frames to 250 to give a much smoother sense of motion
Next, the engineer adjusted each frame's brightness level to be more consistent throughout and fix the sun damage in the footage.
Shiryaev then used an ensemble of neural networks to upscale the result to the highest resolution he could and added as many frames as possible to the original footage.
'In the final result I was able to generate 250 frames from 20 original ones and looped the final result,' he said.
The primitive footage, shot in October 1888, was upscaled with an ensemble of neural networks, which 'redraws' the missing data and increase the frame resolution 4x or more
This sequence, from possibly the earliest surviving film taken by Louis le Prince, shows Mr and Mrs Whitley, le Prince's parents-in-law, his son Adolphe and Harriet Hartley in the Whitley's garden in Leeds
Original frames
A specifically trained neural network provides an approximate artificial coloration of each frame, and although this colourisation is not historically accurate, the effect appears natural in the finished video.
As a finishing touch, he added sound effects including the soft sounds of birds singing to complement the garden setting.
Shiryaev says the images downloaded from the Science Museum webpage are not the best quality and that he would re-do the whole process if he can get access to other sources.
'The most serious problem is that the source quality for this work is an image file that I downloaded from the UK Science Museum webpage, so if you have a better scan, please contact me,' he said.
'I will happily re-do all the work to achieve the best result possible.'
Artificial intelligence has been used to upscale the oldest film in existence, recorded in a garden in Leeds 132 years ago.
Roundhay Garden Scene is a short film shot on October 14, 1888, showing four people strolling around the garden of Oakwood Grange in the Leeds suburb of Roundhay.
The original black and white video, recorded by French inventor Louis Le Prince, is only 1.66 seconds long and comprises just 20 frames.
But YouTuber Denis Shiryaev has posted a new version of the legendary video on his site, which is now in 4K quality at around 250 frames per second.
Using a neural network to fill in the blanks and artificially generate additional frames, Shiryaev has been able to upscale the 20 original frames to give a much smoother sense of motion.
Artificial colouring and face restoration techniques have also made the Victorian-era video seem like it was shot with modern camera equipment. Today we will time travel to the year 1888 in Leeds, England,' Mr Shiryaev says in his video, posted to YouTube.
'Maybe you have seen this GIF or poor quality video, I have decided to apply the full force of modern machine learning algorithms to improve the original quality.'
The four subjects in the video, who are friends and family of Le Prince, are purposely walking in a circle to keep within the area framed by Le Prince's single lens camera, which he invented and made himself.
But the problem with this video is that the original footage was probably around only 12 frames per second, Shiryaev estimates, which is extremely low and only leaves 20 frames to work with.
Firstly, Shiryaev downloaded the 20 positive frames for free from the British Science Museum's webpage.
The Science Museum had created photographic glass plate copies in the 1930s from the original paper negatives created by Le Prince.
Then, Shiryaev divided the 20 frames up and aligned them in the software so the subjects were in a consistent position across the frames.
He then added a stabilisation algorithm and applied an aggressive face restoration neural network to add more details to the individual faces in the frames.
The three-second short silent film was recorded by French inventor Louis Le Prince, who made an early motion picture camera
Shot from the film before the colourisation was added. Shiryaev has been able to upscale the 20 original frames to 250 to give a much smoother sense of motion
Next, the engineer adjusted each frame's brightness level to be more consistent throughout and fix the sun damage in the footage.
Shiryaev then used an ensemble of neural networks to upscale the result to the highest resolution he could and added as many frames as possible to the original footage.
'In the final result I was able to generate 250 frames from 20 original ones and looped the final result,' he said.
The primitive footage, shot in October 1888, was upscaled with an ensemble of neural networks, which 'redraws' the missing data and increase the frame resolution 4x or more
This sequence, from possibly the earliest surviving film taken by Louis le Prince, shows Mr and Mrs Whitley, le Prince's parents-in-law, his son Adolphe and Harriet Hartley in the Whitley's garden in Leeds
Original frames
A specifically trained neural network provides an approximate artificial coloration of each frame, and although this colourisation is not historically accurate, the effect appears natural in the finished video.
As a finishing touch, he added sound effects including the soft sounds of birds singing to complement the garden setting.
Shiryaev says the images downloaded from the Science Museum webpage are not the best quality and that he would re-do the whole process if he can get access to other sources.
'The most serious problem is that the source quality for this work is an image file that I downloaded from the UK Science Museum webpage, so if you have a better scan, please contact me,' he said.
'I will happily re-do all the work to achieve the best result possible.'
No comments: