Free Code for Eulerian Video Magnification Changes the World

Eulerian Video Magnification for Revealing Subtle Changes in the World

Hao-Yu Wu1 Michael Rubinstein1 Eugene Shih2 John Guttag1 Frédo Durand1 William T. Freeman1
1MIT CSAIL 2Quanta Research Cambridge, Inc.
An example of using our Eulerian Video Magnification framework for

visualizing the human pulse. (a) Four frames from the original video

sequence. (b) The same four frames with the subject’s pulse signal

amplified. (c) A vertical scan line from the input (top) and output

(bottom) videos plotted over time shows how our method amplifies

the periodic color variation. In the input sequence the signal is

imperceptible, but in the magnified sequence the variation is clear.

Abstract

Our goal is to reveal temporal variations in videos that are difficult or impossible to see with the naked eye and display them in an indicative manner. Our method, which we call Eulerian Video Magnification, takes a standard video sequence as input, and applies spatial decomposition, followed by temporal filtering to the frames. The resulting signal is then amplified to reveal hidden information. Using our method, we are able to visualize the flow of blood as it fills the face and also to amplify and reveal small motions. Our technique can run in real time to show phenomena occurring at temporal frequencies selected by the user.



@article{Wu2012Eulerian,
author = {Hao-Yu Wu and Michael Rubinstein and Eugene Shih and John Guttag and Fr'{e}do Durand and William T. Freeman},
title = {Eulerian Video Magnification for Revealing Subtle Changes in the World},
journal = {ACM Trans. Graph. (Proceedings SIGGRAPH 2012)},
year = {2012},
volume = {31},
number = {4},
}

Paper: pdf (errata)

Supplemental: pdf (the derivation in Appendix A in the paper given in more detail)

SIGGRAPH 2012 Presentation: zip (150 MB)

Visualization of Eulerian motion magnification (Courtesy of Lili Sun)

Check out Videoscope by Quanta Research – upload your videos and have them magnified!

SIGGRAPH Supplemental Video:

Download: mov (220 MB)

Media Coverage

MIT News Researchers amplify variations in video, making the invisible visible Video
Technology Review Software Detects Motion that the Human Eye Can’t See
BBC Radio interview MIT Video colour amplification
Wired (UK) MIT algorithm measures your pulse by looking at your face
Gizmodo New X-Ray Vision-Style Video Can Show a Pulse Beating Through Skin
PetaPixel Magnifying the Subtle Changes in Video to Reveal the Invisible
Huffington Post MIT’s New Video Technology Could Give You Superhuman Sight
Spiegel Online (German) Video software can make pulse visible
Imaging Resource Is baby still breathing? Find out… from a video!

Code

Matlab (2 MB, v1.1 2013-03-02) – reproduces all the results in the paper (see README.txt for details).

This code is provided for non-commercial research purposes only. By downloading and using the code, you are consenting to be bound by all terms of this software release agreement. Contact the authors if you wish to use the code commercially.

Please cite our paper if you use any part of the code or data supplied on this web page.

* This work is patent pending

Data

All videos are in MPEG-4 format and encoded using H.264.

source result source result source result source result (color)

result (motion)

source result (low E) result (A)
source result source result source result source result

Acknowledgements

We would like to thank Guha Balakrishnan, Steve Lewin-Berlin and Neal Wadhwa for their helpful feedback, and the SIGGRAPH reviewers for their comments. We thank Ce Liu and Deqing Sun for helpful discussions on the Eulerian vs. Lagrangian analysis. We also thank Dr. Donna Brezinski, Dr. Karen McAlmon, and the Winchester Hospital staff for helping us collect videos of newborn babies. This work was partially supported by DARPA SCENICC program, NSF CGV-1111415, and Quanta Computer. Michael Rubinstein was partially supported by an NVIDIA Graduate Fellowship.

Last updated: Nov 2012

www.againstcronycapitalism.org

http://www.againstcronycapitalism.org/

What is crony capitalism?

Crony capitalism and genuine capitalism, if not opposites, are fundamentally opposed. Unfortunately the broader public, to date, is largely unaware of this.

Crony capitalism is the marriage of the state and private special interests. Some people have called it corporatism, mercantilism, fascism, or even Communism. (Socialism?)

We will call it crony capitalism.

By whatever name, it is phony “capitalism.”

Over the years the public has been taught that many of the problems it faces on a day to day basis such as the lack of jobs, rising prices, corruption in Congress, and so on are a result of capitalism.

If so, it is a perverted capitalism.

These unsavory realities are largely the result of government/private “partnerships.” Whether in banking, agriculture, housing, energy, transportation, manufacturing, or nearly any other facet of the economy, the “unsavory” parts are often the result of public/private collusion.

Why can’t you get any kind of return on your money in a CD, the traditional vehicle for retirees? Crony capitalism.

Why can Goldman Sachs, the largest investment bank, speculate in markets using newly printed government money that has been borrowed virtually for free? Crony Capitalism.

Why is Detroit a shadow, barely a shadow, of what it once was? Crony capitalism.

Why are there more farm regulators than farmers? Crony capitalism.

Why does Congress write laws that are longer than the Old Testament with obscure, impossible to understand language? Crony capitalism.

When the state and powerful private interests collude the result is a cocktail of market distortion.

Genuine capitalism in comparison, is quite simple. Capital is invested by individuals to further ideas and enterprises that the investor thinks will create a return on the money invested. If the enterprise in question is a good one, both investor and business owner win. If not- better luck next time.

It’s clear. It’s simple. It’s moral.

However, invariably once the state gets involved as investor, or “regulator”, things start to morph and twist. As sure as the sun rises, coercion and corruption rear their heads.

Crony capitalism can take many forms including regulatory capture ( regulated interests actually using government power to squelch competition), zoning, licensing, in some cases even copyright, and hundreds of other ways. The one thing all of these “tools” have in common, however, is that they are used by the politically connected few to extract money and power from the unconnected many.

Government gives a veil of legitimacy to actions taken by individuals and groups that would be considered unethical (at best) without government “permission.” More often government also uses its power to make everyone play along. If you break a law, you can go to jail.

What We Believe

We believe that special deals from government for politically connected individuals, businesses, and powerful political interests destroy the marketplace. These favors, though often sold to the public as “regulations” or “works programs”, are usually vehicles for some to take from the many.

When powerful interests are permitted to use the coercive power of the state for private ends, there is no end to the economic destruction that can be wrought.

From shady zoning regulations in a small town, to billion dollar bailouts for international banks, to billions of newly printed dollars flowing from government to Wall St at virtually free rates, crony capitalism takes many forms. We seek to identify it, and record its impact day to day.

In recent years, we have seen vast increases in cronyism. Though cronyism has always existed, and likely always will, the brazenness by which some in advantageous positions have used the state to further their ends in the last few years is unprecedented in the United States. It is even worse than the in the “Robber Baron” era after the Civil War.

In a country that prides itself on honesty, innovation, and embracing the entrepreneurial spirit, such a state of affairs can not be permitted to persist. If it does persist, we won’t have much of an economy left.

If the distinction between private enterprise and government is lost, if it’s all a blur, the average person will become poorer and poorer. The quality of life for the average American may never come back.

We believe that the increasing partnership between government, business, and other special interests such as unions and trial lawyers in recent years is anathema not only to a sound economy, but to a civically vibrant and free society.

We are for freedom, transparency, opportunity, and honest markets.

We are against crony capitalism.

Livefyre Not Displaying on this post

Newsletter

<tdstyle=”font-weight: color:#585858;”=”” font-size:<span=”” pre=””>12px;=”” font-family:arial;=”” bold;=””>
Email Address:
Privacy Policy
Follow Us

Related articles

Baylen Linnekin on Crony Capitalism vs. American Food (reason.com)
Think Tanks Vs. Crony Capitalism (stateofglobe.com)
Fed President: Too Big Banks Are Just Crony Capitalists (stateofglobe.com)
David Stockman on Crony Capitalism (ritholtz.com)
Newsflash: Crony Capitalism is a Creature of the State (coordinationproblem.org)
The RNC’s Empty Rhetoric on Combating Crony Capitalism (thedailybeast.com)
Income Growth for Bottom 90% in America Since 1966 is…59 Dollars (sgtreport.com)
Fed President: Too Big Banks Are Just Crony Capitalists (washingtonsblog.com)
CAG will uncover crony capitalism: Rai (assamtribune.com)
Crony Capitalism and the Crisis of the West (palamas.info)

Create a website or blog at WordPress.com

Up ↑

%d bloggers like this: