Neural networks and related technologies have proven to be transformational technologies. Various technological advances have enabled breakthroughs beyond what many would have predicted when the field's popularity was on the rise. However, many challenges remain. Some of the field's progress will be described while key future challenges and approaches to them will be outlined. Of particular promise are approaches that offer hybrids of previously successful methods in novel combinations.