Human Generated Data

Title

Untitled (cub scouts gathered around chalkboard)
Date

1954
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10422
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (cub scouts gathered around chalkboard)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 97.7
Human 97.7
Person 97.3
Person 96.9
Person 94.9
Person 92.5
Helmet 87.5
Clothing 87.5
Apparel 87.5
Person 64.1
Table 61.9
Furniture 61.9
Person 61
Cafeteria 59.3
Restaurant 59.3
Classroom 59
Indoors 59
School 59
Room 59
Clinic 55.5

Imagga
created on 2022-01-09

iron lung 60.2
respirator 48.1
breathing device 37.4
device 31.9
man 18.1
person 17.4
equipment 16.3
male 16.3
people 16.2
technology 15.6
case 14.2
black 13.2
science 12.4
adult 12.3
modern 11.9
health 11.8
working 11.5
work 11.1
medical 10.6
home 10.4
business 10.3
table 9.8
human 9.7
house 9.2
studio 9.1
glass 9.1
medicine 8.8
party 8.6
luxury 8.6
metal 8
celebration 8
interior 8
hospital 7.7
setting 7.7
professional 7.7
dishwasher 7.5
care 7.4
glasses 7.4
computer 7.4
wedding 7.3
light 7.3
painting 7.2
suit 7.2
body 7.2
worker 7.1
indoors 7

Google
created on 2022-01-09

Black-and-white 84.8
Style 83.9
Monochrome photography 75.1
Snapshot 74.3
Motor vehicle 74
Monochrome 74
Room 68.8
Font 68.8
Hat 68.6
Event 67.4
Art 67.1
Team 63.2
Stock photography 62.9
Still life photography 57.3
Personal protective equipment 56.4
Suit 55.6
Chair 54.8
Serveware 51.5
Visual arts 51.1

Microsoft
created on 2022-01-09

text 96.6
person 91.3
drawing 76.4
cartoon 75.7
clothing 50.7

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 91.4%
Sad 62.7%
Calm 35.2%
Confused 1%
Surprised 0.6%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 29-39
Gender Male, 95.3%
Calm 78%
Surprised 14.2%
Angry 2.5%
Confused 2.2%
Sad 1.7%
Happy 0.8%
Disgusted 0.4%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Helmet 87.5%

Captions

Microsoft

a group of people around each other 61.6%
a group of people playing instruments and performing on a stage 37.9%
a group of people on a stage 37.8%

Text analysis

Amazon

34
METHODS
BANK
DEN
SELLING
INDIVIDUAL
LOCAL
TICKETS
30
68
baby
FALMER
4 30 68
with
mother
4
BOYS
SELLIN
CITIZENS
with you
METHODS of SELLING TICKETS
but
BOOK-TO
I. INDIVIDUAL BOYS SELLIN LOCAL
you
2 TICKET
2 TICKET BOOTHS
BOOTHS
moni
th
DENI
ur baby
DENS
DEN 3- FALMER CANK
3-
SARABOTA
3
of
DEN4
DEN 5 CITIZENS BANK +fass OFFKE
DENI BALGERS
3 BOOK-TO BOOK 6 DENS
DEN4 SARATO BANK DR
ved
BOOK
DEN 2-SARASSA LAVR
BALGERS
I.
SARATO
5
ur
went
2-SARASSA
DR
OFFKE
6
DA
LAVR
CANK
+fass
LAFE

Google

DEN 5 CITRENS GANK +PST OFFKE 430 68 th you her METHODS OF SELLIMG TICKETS 1 MDIVIDUAL BOYS SELLIN LOA Gs 2TICKET GOOT HS DENI BAERS DEN 2 SARASTA BAVK DEN 3- FALMER oWK LEN 4 SARATA BANK DR buby DOOR-TO DOOR Y DENS but moni
DEN
5
CITRENS
GANK
+PST
OFFKE
430
68
th
you
her
METHODS
OF
SELLIMG
TICKETS
1
MDIVIDUAL
BOYS
SELLIN
LOA
Gs
2TICKET
GOOT
HS
DENI
BAERS
2
SARASTA
BAVK
3-
FALMER
oWK
LEN
4
SARATA
BANK
DR
buby
DOOR-TO
DOOR
Y
DENS
but
moni