Human Generated Data

Title

Untitled (cub scouts gathered around chalkboard)

Date

1954

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10424

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (cub scouts gathered around chalkboard)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 98.8
Human 98.8
Person 98.5
Person 97.2
Clothing 96.4
Apparel 96.4
Helmet 96.4
Person 96.3
Person 90.1
Indoors 77.3
Room 77.3
Clinic 75.6
Lab 69.9
Person 66.6
School 66.1
Classroom 66.1
Person 65.8
Hospital 55.3

Imagga
created on 2022-01-09

case 51.9
glass 21.1
table 19.9
setting 15.4
room 14.7
dinner 14.4
medical 14.1
wine 13.8
luxury 13.7
home 13.6
man 13.4
hospital 13.3
interior 13.3
furniture 13
party 12.9
plate 12.7
house 12.5
celebration 12
wedding 11.9
work 11.9
technology 11.9
people 11.7
restaurant 11.4
dining 11.4
health 11.1
service 11.1
decoration 11.1
drink 10.8
science 10.7
food 10.4
glasses 10.2
event 10.2
care 9.9
human 9.7
decor 9.7
medicine 9.7
fork 9.6
clothing 9.4
surgeon 9.3
male 9.2
kitchen 8.9
digital 8.9
reception 8.8
indoors 8.8
device 8.7
iron lung 8.7
flowers 8.7
knife 8.6
arrangement 8.6
business 8.5
person 8.5
metal 8
working 7.9
holiday 7.9
design 7.9
banquet 7.8
dishwasher 7.8
color 7.8
render 7.8
3d 7.7
modern 7.7
china cabinet 7.6
chair 7.6
bouquet 7.5
alcohol 7.5
equipment 7.5
machine 7.4
container 7.4
inside 7.4
tray 7.3
cabinet 7.1
romance 7.1
worker 7.1
day 7.1

Google
created on 2022-01-09

Hat 85.3
Black-and-white 84.4
Style 83.8
Art 76.5
Snapshot 74.3
Monochrome photography 74
Monochrome 73.4
Font 72.9
Event 67.8
Room 67.5
Motor vehicle 66.9
Service 64.5
Stock photography 63.8
Chair 59.9
Team 59
Photo caption 55.6
Crew 54.5
History 53.8
Circle 52.8
Eyewear 52.3

Microsoft
created on 2022-01-09

text 94.5

Face analysis

Amazon

AWS Rekognition

Age 25-35
Gender Male, 92%
Calm 84.6%
Surprised 12.6%
Sad 1.1%
Angry 0.6%
Happy 0.5%
Confused 0.2%
Disgusted 0.2%
Fear 0%

AWS Rekognition

Age 25-35
Gender Male, 56%
Calm 96.7%
Sad 1.9%
Fear 0.8%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Female, 87.7%
Calm 99.1%
Surprised 0.5%
Sad 0.2%
Happy 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

Feature analysis

Amazon

Person 98.8%
Helmet 96.4%

Captions

Microsoft

a group of people around each other 64.1%
a group of people sitting at a table 55%
a group of people posing for a photo 54.9%

Text analysis

Amazon

DEN
SELLING
TICKETS
LOCAL
34
METHODS
BANK
with
SARASOTA
INDIVIDUAL
baby
SELLIN
mother
METHODS OF SELLING TICKETS
but
ed
BADGERS
BOOTHS
BOYS
DENS
DEN4
with you
5
IN
DRIVE
OF
3.
you
DEN4 SARATO BANK DRIVE IN
2.TICKET BOOTHS
mon
3. DOOR-TO-DOOR or DENS
DOOR-TO-DOOR
43075
DEN 5 CITILENS BANK+POST OH
1. INDIVIDUAL BOYS SELLIN LOCAL NEIGHOPE
١٢ baby
DEN2 SARASOTA BANK
OH
2.TICKET
FALMER
or
CITILENS
DEN 3- FALMER BANK
DENI- BADGERS
١٢
BANK+POST
TLA
1.
SARATO
LOT
Hh
3-
DENI-
DEN2
NEIGHOPE
MU3--YT33A°--XAX

Google

LOCAL
NEIG
DEN
ALMER
BANK+fST
S
DOOK-TO
mon
43075
1.
INDIVIDUAL
BOYS
DENI-
BANK
DRNEM
OY
th you yather METHODS OF SELLING TCKETS 1. INDIVIDUAL BOYS SELLIN LOCAL NEIG 2TICKET BOOTHS DENI- BAERS DEN 2 SARASCTA BAVK DEN 3- ALMER GWK DEN 4 SARAATA BANK DRNEM DEN S CITENS BANK+fST OF S DOOK-TO DoOk OY DENS baby CO 34 mon 43075 34
th
METHODS
SELLIN
BOOTHS
3-
you
OF
SELLING
2TICKET
BAERS
GWK
SARAATA
CITENS
DENS
baby
34
yather
TCKETS
2
SARASCTA
BAVK
4
DoOk
CO