Building A.I. That Can Build A.I.

SAN FRANCISCO — They are a dream of researchers but perhaps a nightmare for
highly skilled computer programmers: artificially intelligent machines that can build other artificially intelligent machines. With recent speeches in both Silicon Valley and China, Jeff Dean, one of Google’s leading engineers, spotlighted a Google project called AutoML. ML is short for machine learning, referring to computer algorithms that can learn to perform particular tasks on their own by analyzing data. AutoML, in turn, is a machine-learning algorithm that learns to build other machine-learning algorithms.
With it, Google may soon find a way to create A.I. technology that can partly take the humans out of building the A.I. systems that many believe are the future of the technology industry. The project is part of a much larger effort to bring the latest and greatest A.I. techniques to a wider collection of companies and software developers.
The tech industry is promising everything from smartphone apps that can recognize
faces to cars that can drive on their own. But by some estimates, only 10,000 people worldwide have the education, experience and talent needed to build the complex
and sometimes mysterious mathematical algorithms that will drive this new breed of artificial intelligence. The world’s largest tech businesses, including Google, Facebook and Microsoft, sometimes pay millions of dollars a year to A.I. experts, effectively cornering the market for this hard-to-find talent. The shortage isn’t going away anytime soon, just because mastering these skills takes years of work. The industry is not willing to wait. Companies are developing all sorts of tools that will make it easier for any operation to build its own A.I. software, including things like image and speech recognition services and online chatbots. “We are following the same path that computer science has followed with every new type of technology,” said Joseph Sirosh, a vice president at Microsoft, which recently unveiled a tool to help coders build deep neural networks, a type of computer algorithm that is driving much of the recent progress in the A.I. field. “We are eliminating a lot of the heavy lifting.” This is not altruism. Researchers like Mr. Dean believe that if more people and companies are working on artificial intelligence, it will propel their own research. At the same time, companies like Google, Amazon and Microsoft see serious money in the trend that Mr. Sirosh described. All of them are selling cloud-computing services that can help other businesses and developers build A.I. “There is real demand for this,” said Matt Scott, a co-founder and the chief technical officer of Malong, a start-up in China that offers similar services. “And the tools are not yet satisfying all the demand.” This is most likely what Google has in mind for AutoML, as the company continues to hail the project’s progress. Google’s chief executive, Sundar Pichai, boasted about AutoML last month while unveiling a new Android smartphone. Eventually, the Google project will help companies build systems with artificial intelligence even if they don’t have extensive expertise, Mr. Dean said. Today, he estimated, no more than a few thousand companies have the right talent for building A.I., but many more have the necessary data. “We want to go from thousands of organizations solving machine learning problems to millions,” he said. Google is investing heavily in cloud-computing services — services that help other businesses build and run software — which it expects to be one of its primary economic engines in the years to come. And after snapping up such a large portion of the worlds top A.I researchers, it has a means of jump-starting this engine. Neural networks are rapidly accelerating the development of A.I. Rather than building an image-recognition service or a language translation app by hand, one line of code at a time, engineers can much more quickly build an algorithm that learns tasks on its own. By analyzing the sounds in a vast collection of old technical support calls, for instance, a machine-learning algorithm can learn to recognize spoken words. But building a neural network is not like building a website or some run-of-the-mill smartphone app. It requires significant math skills, extreme trial and error, and a fair amount of intuition. Jean-Fransois Gagna, the chief executive of an independent machine-learning lab called Element AI, refers to the process as “a new kind of computer programming. In building a neural network, researchers run dozens or even hundreds of experiments across a vast network of machines, testing how well an algorithm can learn a task like recognizing an image or translating from one language to another. Then they adjust particular parts of the algorithm over and over again, until they settle on something that works. Some call it a “dark art,” just because researchers find it difficult to explain why they make particular adjustments. But with AutoML, Google is trying to automate this process. It is building algorithms that analyze the development of other algorithms, learning which methods are successful and which are not. Eventually, they learn to build more effective machine learning. Google said AutoML could now build algorithms that, in some cases, identified objects in photos more accurately than services built solely by human experts. Barret Zoph, one of the Google researchers behind the project, believes that the same method will eventually work well for other tasks, like speech recognition or machine translation. This is not always an easy thing to wrap your head around. But it is part of a significant trend in A.I. research. Experts call it “learning to learn” or “meta-learning.” Many believe such methods will significantly accelerate the progress of A.I. in both the online and physical worlds. At the University of California, Berkeley, researchers are building techniques that could allow robots to learn new tasks based on what they have learned in the past. “Computers are going to invent the algorithms for us, essentially,” said a Berkeley professor, Pieter Abbeel. “Algorithms invented by computers can solve many, many problems very quickly — at least that is the hope.” This is also a way of expanding the number of people and businesses that can build artificial intelligence. These methods will not replace A.I. researchers entirely. Experts, like those at Google, must still do much of the important design work. But the belief is that the work of a few experts can help many others build their own software. Renato Negrinho, a researcher at Carnegie Mellon University who is exploring technology similar to AutoML, said this was not a reality today but should be in the years to come. “It is just a matter of when,” he said.

See the whole article here

Advertisements

Tech lobby thrilled about computer coding in schools

People who work in Saskatchewan’s technology sector are applauding the provincial government’s pledge to introduce new computer coding courses in elementary and high schools, hoping to solve an industry-wide labour crunch. The province’s tech sector is still comparatively small, but rapid growth has resulted in a shortage of experienced software developers, and the problem is expected to get worse, according to a spokesman for a new industry lobby group. “We can identify several hundred open jobs right now,” said Aaron Genest, who works for the computer chip developer Solido Design Automation Inc. and speaks for SaskTech, which represents more than 40 companies with about 5,000 employees. “It’s an early indicator of the challenges that we’re going to face in 10, 15, 25 years … In the long term, we need to prepare our children to see (computer science) programs as part of their future.” The Saskatchewan Party

images

SaskTech spokesman Aaron Genest in the Saskatoon offices of Solido Design Automation Inc.

government committed to developing the curriculum in its throne speech, which was read in the legislature on Wednesday. It said the courses will prepare children for careers in science, engineering and technology.  The promise emerged from consultations with SaskTech and the broader industry.  Education Minister Bronwyn Eyre said this week that while the mechanics have yet to be worked out, she would like to see the courses being taught “as soon as possible.” She declined to provide a specific timeline but said enthusiasm for the proposal is widespread. The main challenge is a shortage of qualified teachers, the Stonebridge–Dakota MLA said. Saskatchewan only has about 70 teachers qualified to instruct high school students in computer science, and the province’s two education colleges must work to increase that number, she said. Saskatchewan’s 28 school boards have spent the last six months grappling with a 1.2 per cent, or $22 million, operational funding reduction handed down in the government’s unpopular 2017-18 budget, which aims to halve a $1.2 billion deficit this year. Eyre said the province’s financial situation has “no relevance” to the development of coding courses. “Now that the focus is there, and so the resources will, I’ve been assured, fall into place,” she said.  Michelle Naidu, associate director of development for the Saskatchewan Teachers Federation, noted it takes years to develop new courses, and professional development resources are already scarce; however, she said the proposed courses could benefit students. “Computational thinking is going to start showing up in all kinds of jobs as we move away from people doing work,” said Naidu, who is also the president of the Saskatchewan Math Teachers Society. “It’s really hard to predict the future, but everyone seems to be very happy to understand that technology is going to play a larger role in everyone’s future, and so that understanding of the basics of how that works is to everyone’s advantage.” Genest said SaskTech is thrilled the government was open to considering the industry’s proposals, and that while introducing the courses will take time it signals a willingness to boost an emerging sector in the provincial economy.  “It means that they’re committing to a homegrown solution to it (so) that Saskatchewan citizens are going to be able to step in and fill the gap in a technology-driven future.” Measuring the size of the province’s tech sector is difficult, as its work is diverse and often overlaps with other industries. However, the provincial government estimates its economic impact is around $540 million — just under one per cent of the provincial GDP. “Absolutely, it has economic potential,” Eyre said of the proposal. “And absolutely that’s why we’re doing it. We need to take our place as a province that offers this to our students.”

 

Google Student Blog: Applications are open for 2018 scholarship opportunities in the US, Canada, and EMEA!

Google is proud to offer academic scholarships and development opportunities to students from historically underrepresented groups pursuing computer science degrees. We aim to help students from diverse backgrounds become future leaders and role models in computing and technology by breaking down the barriers that prevent them from entering these fields.  Selected students will receive a financial award for the 2018-19 academic year and be invited to the annual Google Scholars’ Retreat in their region next summer. At the retreat, scholars will participate in networking and development sessions, including sessions on how to lead outreach in their communities. Scholars also join long term a community of former scholarship recipients for continued networking and development.  Read more to check the details of each program here