►
Description
Presented by Tyrone Grandison
The U.S. Department of Commerce collects, processes and disseminates data on a range of issues that impact our nation. Having a host of data and ensuring that this data is open and accessible to all are two separate issues. This session will cover the Commerce Data Usability Project (CDUP) - a community-driven public-private partnership to help data scientists, programmers and other users to access open knowledge from our open data.
About CodeConf
CodeConf improves the software community by providing a forum for thought-provoking talks and forging social connections. The fourth installment of the CodeConf series took place in Hollywood in 2016. This year's event focused on systems engineering projects, practices, and programs in the open source community.
For more information on this year's CodeConf, go to:
https://codeconf.com/
A
A
A
First,
the
accent
is
Jamaican
and
I
thank
the
organizers
for
winding
up
their
cab
University
component.
Yes,
one
I
started
coding
in
basic
and
assembly
a
long
long
long
time
ago.
Yes,
I,
am
that
old
I've
been
fortunate
enough
to
catch
on
and
develop
some
some
solutions
and
everything
from
mobile
to
list
to
Java
C++
right
now,
my
language
of
choice
is
Python.
If
I'm
feeling
really
lazy
ZAR,
if
you
were
at
the
reception
yesterday,
I
was
leading
the
the
dance
crew
where
my
dance
people
at
stream
I
are
I,
love,
Latin
dancing.
A
One
thing
you
know
about
me
and,
more
importantly,
I
am
an
impact,
junkie
and
I.
Think
it's
true
of
most
people
here
and
also
speaking,
especially
that
we
want
actually
working
projects
which
have
a
high
probability
positive
impact
on
as
many
people
as
possible,
and
that's
why
I
went
to
the
White
House.
That's
why
I'm
at
the
farm
of
Commerce
I,
remember
the
very
first
moment
when
I
realized
how
important
the
impact
of
Commerce
was.
A
I
was
eight
days
into
this
new
gig
I
met
Jesus
Singh
at
the
General
Services
Administration
sitting
with
that
handsome
guy
there
Jeff
Chen,
who
is
a
chief
data
scientist
of
Commerce,
the
most
amazing
data
scientist
that
I
know
and
I
know
part
of
you
and
we're
looking
at
the
data
at
all.
The
different
bureaus
did
an
evaluation.
A
All
the
CalPERS
was
that
there's
a
lot
of
diversity
in
the
data,
a
lot
of
temporal
resolutions
that
we
have
to
sort
through
a
lot
of
different
types,
as
you
expect,
and
it
dawned
on
us
that
the
department
had
several
really
important
contributions
to
most
things,
that
we
were
actually
doing
that
we're
using
every
day
am
I
like
awakening.
My
my
one
moment
was
my
cell
phone,
but
of
like
a
moment
of
of
trust
and
honesty.
A
Here,
if
I
said
to
you
at
this
very
moment
that
you
can
never
ever
have
a
cell
phone
ever
again,
how
many
people
by
Showtime
sort
of
a
panic
attack
right
now?
Oh,
but
that's
not
quarter
a
third
audience.
Everyone
else
you
all
lying
I
know
this
so
I'm
going
to
say
to
you
that
without
the
Department
of
Commerce
and
its
bureaus
and
agencies,
they
would
no
did
not
be
a
social
themselves.
You
have
the
material
standards
for
manufacturing
that
are
basically
reference
materials
from
list
the
National
Institute
of
Standards
and
Technology.
A
You
have
the
IPS
and
technologies
that
are
from
the
USPTO,
the
Patent
and
Trademark
Office.
You
have
the
weather
app
that
uses
data
from
NOAA,
the
National
Oceanic
and
Atmospheric
Administration.
You
have
a
stock
app
that
miski
uses
information
from
bas,
the
Bureau
of
Economic
Analysis,
you
know,
goes
on
spectrum
broadband
NTIA.
We
talk
about
positioning
sensors,
we
talk
about
trade
ITA,
every
single
element
of
this
device
itself,
alls
itself
to
someone
in
commerce
or
some
entity
or
agents
and
commerce
actually
providing
cover
for
it.
A
When
we
actually
look
Depot,
we
actually
realized
that
the
bureau's
did
more
than
just
provide
critical
functions
for
consumer
products.
They
had.
A
lot
of
dates
are
fun.
This
is
gonna
sound
ridiculous,
but
we're
monitoring
the
surface
temperatures
on
the
Sun,
we're
monitoring,
phones,
acoustic,
emanations
at
the
ocean
floor,
just
because
we
can,
when
it
comes
to
open
data
and
open
datasets
on
daily
log
of
the
department,
has
36%
of
all
the
inventory
on
data.gov,
which
is
the
largest
portion
for
any
federal
agency.
A
A
So
this
is
where
leadership
comes
in,
so
the
Secretary
of
the
Department
penny
Pritzker
right.
There
did
something
year
ago,
at
the
time
that
no
other
federal
agency
ever
contemplated
doing
Chilean
data,
an
integral
part
of
our
strategic
plan
and
I
just
had
a
team
up
to
handle
data
itself
in
November,
and
this
is
hard
to
believe
that
status
actually
exists
within
government.
A
Horrible
slide
agony.
Our
team
has
engineers,
they
there's
some
engineers
use,
experienced
people,
data
scientists
and
we
believe
in
everything
that
everyone
here
believes
we
believe
in
open
by
default.
Everything
that
we
use
is
open-source,
we're
agile,
we'll
lean,
and
wouldn't
it
be
amazing
if
he
went
on
a
government
website
and
actually
liked.
The
experience
right
would
be
that's
possible
in
terms
of
what
we
do.
We
actually
build
and
deploy
data
products
and
services
from
the
different
bureaus.
A
We
provide
training
for
employees
and
the
department
commerce,
so
they
can
actually
know
what
agile
is
and
how
to
actually
use.
Python
Ruby
are,
and
we
actually
look
at
the
data.
Well,
there
are
data
sets
internally
to
figure
out
is
their
signal
tense
or
a
fundamental
questions
that
can
improve
their
operations.
A
We
started
off
with
the
team
of
three
the
three
people,
the
top
like
very
top-heavy
in
November
by
January.
We
had
13
people
by
June
the
strategy
and
we
basically
had
30
people
aware
on
that
path
to
we
have
too
much
work
and
not
enough
people
to
actually
do
the
work.
So,
if
you're
looking
for
exciting
data,
an
opportunity,
we're
hiring
send
me
afterwards
and
one
here
to
talk
about
the
first
project
that
we
undertook.
It's
called
the
commerce
diffusability
project
and
you
can
go
to
the
website.
It's
live.
A
It's
ok
and
the
mission
was:
how
do
we
meaningfully
work
with
our
users
to
unlock
that
untapped
data
resources
I
talked
about
earlier,
and
how
do
we
actually
take
people
that
have
no
idea
that
they
can
actually
do
amazing
things
with
ulm
data
and
actually
have
them
either
accelerate
the
business
or
build
new
businesses
or
just
tinker
Owen
and
create
like
solutions
for
their
local
civic
problems?
We
started
off
with
four
initial
data
guides,
or
data
tutorials
and
again
everything
we're
doing
here
is
completely
open.
All
on
github
you
go
to
github
comm
comments.
A
Latest
service
you'll
see
what
we're
working
the
first
one.
We
used
our
studio
leaflet
and
Google
charts
to
visualize
weather
detail
particularly
hail
data
from
NOAA,
which
is
a
National
Oceanic,
Atmospheric
Administration
I
have
to
say
these
because,
like
on
the
East
Coast,
everyone
knows
that
condemns
here.
No
one
gives
a
crap,
that's
fine,
so
NOAA
has
a
lot
of
data.
They
have
this
thing
called
the
severe
weather
data
inventory
sweidy
for
short,
and
it's
hard
to
work
with
this.
Dataset
normally
takes
people
like
3
to
4
months
to
get
a
handle
on
it.
A
A
We
looked
at
NIST,
so
in
this
sense
this
dataset
called
the
national
vulnerability
data
set
on
the
preferred
of
the
national
volume
into
data
set.
Raise
your
hand,
oh,
not
that
many,
so
every
single
security
bug
our
release
that
happens
is
loved
in
the
state
of
is
completely
underused,
extremely
valuable.
We
build
a
data
guide
using
Python,
d3
and
dimple
that
shows
the
seasonal
patterns
and
I
won't
actually
give
it
away.
Go
read
the
tutorial
itself.
A
It's
really
interesting,
like
the
patterns
actually
last
or
go,
go
into
like
a
decade,
same
thing,
same
process
and
we're
trying
to
figure
out
like
why
and
actually
have
new
avenues
of
Investigation
around
it.
Using
our
and
plotly.
We
looked
at
sunlight
data
from
NOAA
again
there's
a
satellite
called
Vera's,
which
stands
for
the
visible
infrared,
imaging
radiometer
suite
say
that
three
times
really
fast,
and
there
is
what
what
it
does
is.
Basically,
it
takes
pictures
of
everything
on
the
Earth's
surface
twice
a
day
and
that
information
is
actually
publicly
available
in
this
tutorial.
A
A
Interestingly
enough,
we
actually
use
this
guide,
provided
it
to
a
bunch
of
hackers
at
de
ataque
and
deficits
fifty
months
ago,
and
they
were
able
to
find
a
really
strong
correlation
between
satellite
imagery
and
the
number
of
incarceration
due
to
mental
health.
Like
if
there
is
a
social
activity,
satellite
leader
can
actually
help
you
like
make
that
connection
or
that
link
in
a
shorter
time
frame.
A
How
many
people
here
want
to
know
where
their
customers
are?
Okay,
people
are
shy
here,
three,
okay,
alright,
thank
you
for
how
many
people
know
that
the
the
information
that
they
need
to
figure
out
where
the
customs
are
is
open
source
is
actually
available
right
now.
The
Census
Bureau
has
a
survey.
This
data
package
called
that
method,
community
surveys
where
they
basically
take
a
survey
of
all
well,
it's
a
randomized
represents,
example
of
all
220
million
Americans
and
they
have
around
two
hundred
thousand
different
attributes
on
American
Americans
lives.
A
So
what
we
did
with
this
tutorial
is
that
we
said
say
your
business,
your
nonprofit
or
for-profit
business,
and
you
want
to
find
out
the
exact
location
like
the
census
tract,
which
is
the
lowest
boundary
that
censuses
operates
in
the
on
census,
is
actually
monitors.
You
wanted
to
know
exactly
like
where
those
customers
are.
If
you
wanted
to
find
out
where
people
between
20
and
30
was
five
miles
from
you
to
have
PhDs
or
whatever
it
is
whatever.
A
So
all
these,
the
previous
tutorials,
were
all
internal
collaborations.
We
work
with
census.
We
worked
with
no
longer
work
at
NIST,
we
do
recognize
or
we
actually
saw
them.
The
intention
make
this
community
driven,
which
is
why
I'm
here
I
want
this
communities
helped
to
actually
take
this
to
the
next
level.
A
We
have
20
data
guides
right
now
in
flight
and
we're
collaborating
with
12
partners,
and
we
have
the
first
couple
examples
of
like
how
you
can
work
with
us
to
actually
create
interesting
tools
that
help
people
use
data
more
effectively.
The
first
is
with
Zillow
and
Zillow
uses
Tudor
digital
with
census,
ACS
data,
which
is
all
our
to
create
the
other
guides
that
showcase
the
affordability
of
housing
in
different
census,
tracts
different
census
tract
is
technically
your
own
six
blocks.
So
to
speak.
A
A
How
many
people
know
about
atmospheric
rivers?
Raise
your
hand
one
person.
You
are
special,
let's
talk
afterwards,
so
for
everyone
else.
Atmospheric
rivers
are
narrow
regions
in
the
atmosphere
that
transport
water
across
the
world,
so
imagine
like
a
river
underground.
These
are
rivers
in
the
sky
that
basically
will
differ
in
size
of
course,
and
m1
source
water
that
is
in
them.
A
There's
a
data
set
called
the
precipitable
water
data
set
from
know
again
that
tells
you
where
these
like
blocks
or
these
rivers
are
exist
where
these
big
bodies
of
like
atmospheric
water
are,
and
if
you
know
the
past,
you
know
like
where
the
rivers
are
flowing,
you
can
actually
predict
damaging
rainfalls,
considering
floods
in
claps.
You
help
your
business.
A
We
worked
with
earth
genome,
which
is
a
non-profit
environmental
nonprofit
in
San
Francisco
to
help
del
chemical,
and
that
was
a
dull
chemical
factory
in
Shreveport
Texas
again,
this
is
just
bash
leaflet
and
some
Raphael
and
Dell
had
a
problem
of
you
know
they
had
this
big
site
in
Freeport.
They
spend
a
lot
of
money
on
producing
the
products
that
they
produce
and
they
employ
a
lot
of
people,
but
they
also
use
hundreds
of
thousands
of
gallons
of
water
and
they're
right
on
the
Brazos
River.
A
The
problem
was
that
they
had
legal
issues
so
to
speak
with
the
people
there.
So
what
we
did
is
that
we
used
topological
data
from
NOAA
and
you
can
see
you
know
the
different
heights
and
I
like
this,
because
the
treaty,
my
vegetables,
is
phenomenal.
We
use
the
data
attached
to
show
the
world
a
good
spot
for
them
that
you
said
their
location
up.
So
how
do
you
actually
put
your
next
plant
at
the
position
where
you
don't
have
the
technical
know,
the
legal
entanglements
and
its
socially
responsible.
A
We
worked
with
tableau
and
the
patent
trademark
office
to
figure
out.
How
do
we
unlock
all
this
present
information
that
everyone
knows
is
valuable
on
some
level,
but
no
one
can
actually
use
one
because
and
honestly,
the
patent
database
not
patent
database,
but
the
pattern
website
is
horrible
to
navigate
a
few
months
ago.
At
you
last
month,
we
just
released
with
the
digital
services
team
in
PTO
developer,
that
uspto.gov,
so
API
visualizations
finally
makes
the
data
accessible
and
now
we're
just
trying
to
get
people
to
actually
use
it
in
meaningful
ways.
A
This
guide
tells
you
what
the
most
innovative
sectors
are
in
each
particular
state
and
you
could
actually
drill
down
to
the
federal
level
if
you
want
so,
where
do
I
need
help
so
I
need
you
to
play
with
this.
To
use
the
tutorials,
create
issues
pretty
ARS
help
us
improve
the
current
set
that
we
have
right
now.
I
need
you
to
work
with
us
collaborate
on
the
next
tutorial,
with
your
favorite
data
set.
A
The
whole
idea
of
this
is
like
we
want
to
capture
knowledge
like
you
could
be
working
the
data
set
for
a
month
two
months.
Three
months
and
there's
a
republic
additional
players,
we
can
actually
keep
that
knowledge
and
actually
give
it
to
other
resident
community
to
use,
and
someone
else
has
been
disturbing
that
that
same
issue
for
months
as
well
like
this
is
our
10
to
actually
make
open
data
like
open
knowledge
and
accessible
and
actionable.
A
So
we
want
you
to
hope
to
do
that
if
you're
going
to
do
that,
we
want
you
to
think
about
what
the
novel
question
is
that
you're
going
to
post.
We
want
you
to
have
at
least
two
engaging
visualizations,
and
this
shouldn't
come
as
a
surprise
to
anyone
here,
but
like
everything
we
do
is
open,
so
code
is
open.
The
data
is
open
all
the
work,
all
the
understanding
should
be
open
as
well.
A
If
you
have
any
questions,
you
can
tweet
at
me
right
there
or
you
can
email
me
to
Granderson
at
do
sea-gulls.
If
you
want
to
look
at
what
the
Commerce
data
service
is
doing,
that's
the
first
thing.
Contempt.
If
you
want
to
engage
you
today
to
be
able
to
project.
The
second
link
do
be
careful
because
we're
changing
the
look
and
feel
of
both
of
these
websites
in
the
next
three
weeks,
SiC
and
capture
right
now
and
go
back
into
month
time
to
what
we're
doing
we've
done
with
it.
A
So
the
question
is
so:
we
have
these
tutorials.
Are
they
aimed
at
getting
people
to
use
a
data
sense
or
teaching
and
data
science?
So
the
tutorials
are
geared
towards
teaching
people
how
to
use
the
data
sets
for
teaching
of
data
science.
We
do
have
a
repo
call,
the
Commerce
data
kademan
or
you
can
go
to
data
academy.com
ourselves.
We
basically
have
tutorials
on
teaching
data
science
to
Rhino
commerce,
employees,
but
don't
tell
nobody
is
all
open,
so
you
can
decide
it
anyway
right.