A Neural Algorithm of Artistic Style


(Andrea Volpato) #21

@Tobias nice to see a very rapid development in this field

I found another interesting article from the Google Research blog in which they mix styles from different paintings and perform some real time computations through a webcam.

with the attached arXiv paper: https://arxiv.org/abs/1610.07629


(Tobias) #22

I’ve just read the blog from David Revoy and found this:

… I was invited to join during a couple of day his workplace to work on the research of a “Style transfert” method. …

http://www.davidrevoy.com/article324/smart-coloring-preview-of-a-new-gmic-filter

Could you tell us more about your research?


(David Tschumperlé) #23

Well, not so much to say at this point. At the lab, we have started working on the problem of style transfer (without the use of CNN or course :p). And we have asked David Revoy, a real artist, to help defining what is really a successful style transfert, and more generally what is the “style” of an image, etc… so we can try to model it mathematically, but from an artistic point of view.
That’s really the start, and I hope we’ll get something to put into G’MIC some day :slight_smile:


(Lyle Kroll) #24

GAOTD has such a tool for free being offered for today only, but from reading the replies on this mega-download, I think I’ll pass. lol

Regardless, maybe some of you more adventurous people who don’t mind risking their PCs crashing might give this one a try. I personally will wait for David to perfect the G’MIC transfer algorithm. :wink:

:slight_smile:


#25

I have installed and uninstalled this “app” on Win7. It does some tricks, but looks quite limited and also half-made. Does not deserve to be compared to G’MIC, is my opinion.


(Lyle Kroll) #26

After seeing some of their examples, I completely agree with you, Jacal. :slight_smile:


#27

There is a new paper (22.03.2017) with a not painting style approach. Seems it is very good on lightning afterwards, like in night for day shots, or the other way around.
There are some functions about the method in it, but its all jibber jabber for me.
But maybe David Tschumperlé knows more about it and how to use it in GMIC.
It would be really great addition to Natron, and open source in general.
Adobe has got his fingers in it, so its likely to see in Photoshop, Premiere Pro and/or After Effects…


#28

One of my hobbies is reading about image processing. It is a love-hate relationship because I don’t have a background in mathematics or programming, and as a non-scientist, I have limited access to papers, code and resources. In terms of papers, I really dislike the research (patent) paywall (red tape).


Anyway, here are some thoughts that come to mind after skimming through this thread:

  • Machine learning (ML) is certainly a hot topic nowadays. What I am wondering is: Does G’MIC have the capability to address machine learning? If not, is it feasible to extend it to the point where it can? Or is there another open source project that could better address the problem?
  1. @iarga brings up a good point that shouldn’t be missed.

The genius of ML is that it can be adapted for (m)any type of problem(s). It doesn’t have to necessarily be about the transferring of artistic style. So, I think we can split the discussion into two problems: one about ML and the other about transferring artistic style. As @David_Tschumperle put it:

  • As for yet-another-paper, a quick search yielded this one from IPOL: http://www.ipol.im/pub/art/2016/150/. I know it isn’t exactly about artistic transfer and I don’t have time to read it and play with the demo to see if it is on-topic, but we can always learn from how others approach a similar problem.

PS

  • When it comes to ML, we don’t necessarily have to start from the beginning. There are many pre-trained databases out there that can be used with some caveats after some tweaking. It will be a compromise but a small community with limited resources probably couldn’t match their scale and quality.

#29

Something like this?


(Mica) #30

This looks like fun: https://github.com/luanfujun/deep-photo-styletransfer


#31

those are very wow examples, almost useful dupont would say =)


(Pat David) #32

Bah, @paperdigits beat me to it! :slight_smile:


(Andrew) #33

Yes, anyone set up to do this stuff? - remember the Masashi Wakui look?.. wonder how that might turn out?..


#34

At first glance, it looks awfully similar to color transfer or histogram matching, albeit with good-looking results. E.g.,


#35

I expect the day in which fred or imagemagick use neural networks


#36

snibgo is quite active as well. Put up with a lot of my questions on the IM forum :blush:. Website:


#37

I also expect the day that  snibgo use bash in place of batch :frowning:


#38

Ahh, I didnt know that there is already a github existing to the papers I posted yesterday.
So thats promising :smile:


#39

May be of interest:


I have a painting. How can I automatically turn it into a photo?
(Mica) #40

That’s pretty cool!