Human Generated Data

Title

Untitled (cub scouts gathered around chalkboard)
Date

1954
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10425
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (cub scouts gathered around chalkboard)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 98.8
Human 98.8
Person 98
Clinic 96.9
Person 91.8
Person 89.1
Hospital 87.7
Operating Theatre 83.6
Interior Design 68.3
Indoors 68.3
Doctor 65
Room 60
Person 58.7

Imagga
created on 2022-01-09

specialist 38.2
person 32.7
computer 28.3
work 25.9
people 25.6
laptop 25.6
technology 23.7
man 23.5
patient 22.4
working 22.1
male 22
iron lung 20.5
equipment 19.6
medical 19.4
doctor 18.8
adult 18.2
device 17.8
office 17.7
business 17.6
breathing device 17.2
hospital 16.9
respirator 16.3
professional 16.3
senior 15
medicine 15
nurse 14.4
home 14.3
surgeon 13.6
portrait 13.6
education 13
businesswoman 12.7
student 12.7
health 12.5
worker 12.4
care 12.3
smiling 12.3
men 12
job 11.5
modern 11.2
room 11.2
happy 10.6
attractive 10.5
illness 10.5
looking 10.4
casual 10.2
screen 10
holding 9.9
film 9.5
case 9.5
smile 9.3
uniform 9.2
horizontal 9.2
occupation 9.2
hand 9.1
old 9.1
school 9
lady 8.9
women 8.7
test 8.7
studying 8.6
elderly 8.6
sitting 8.6
notebook 8.6
study 8.4
house 8.4
aviator 8.3
sick person 8.1
desk 8
monitor 8
indoors 7.9
surgery 7.8
face 7.8
corporate 7.7
negative 7.6
keyboard 7.5
one 7.5
executive 7.4
baby 7.2
love 7.1
to 7.1
network 7.1
businessman 7.1

Google
created on 2022-01-09

Black 89.6
Black-and-white 86.9
Style 84
Monochrome 80.3
Monochrome photography 79.5
Room 69.4
Font 66.9
Glass 66
Event 65.6
Hat 65.5
Stock photography 64.9
Motor vehicle 59.7
Sitting 57
Still life photography 52.7
Handwriting 52.2

Microsoft
created on 2022-01-09

text 98.1
person 89.9
black and white 63.1
handwriting 56.6

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 98.7%
Surprised 64%
Happy 16.9%
Calm 13.1%
Angry 2.2%
Confused 1.7%
Sad 1%
Disgusted 0.8%
Fear 0.3%

AWS Rekognition

Age 7-17
Gender Female, 98.3%
Calm 99.9%
Sad 0%
Surprised 0%
Confused 0%
Disgusted 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Male, 95%
Calm 96.6%
Happy 1.4%
Sad 0.8%
Angry 0.3%
Confused 0.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a group of people around each other 52.2%
an old photo of a man 52.1%
a group of people posing for a photo 48%

Text analysis

Amazon

BANK
DEN
SELLING
LOCAL
SARASOTA
PALMER
BADGERS
DENS
CITIZENS
METHODS
SELLIN
43076
BOYS
DOOR-TO-DOOR
3.
34
1. INDIVIDUAL BOYS SELLIN LOCAL
2.TICKET
2.TICKET BOOTHS:
BOOTHS:
INDIVIDUAL
METHODS OF SELLING TICKE
DEN 2- SARASOTA BANK
OF
DEN in PALMER BANK
3. DOOR-TO-DOOR 'BY DENS
DEN 4. SARASOTA BANK DRIVE IN
DENI- BADGERS
DEN in CITIZENS BANK +Post o
1.
in
DRIVE IN
TICKE
DENI-
+Post
ODS
2-
'BY
4.
o
M117--YT37A2--AX

Google

METHODS OF SELLING TICKE 1. INDIVIDUAL: BOYS SELLIN LOCAL ODS 2TICKET BOOT HS! DENI- BADFERS DEN 2 SARASOTA BANK DEN 3- PALMER CANK DEN 4 SARASOTA BANK DRNE IN DEN 5 CITIZENS BANK +POST O R DOOR-TO- DOOR GY DENS 43076
METHODS
OF
SELLING
TICKE
1.
INDIVIDUAL:
BOYS
SELLIN
LOCAL
ODS
2TICKET
BOOT
HS!
DENI-
BADFERS
DEN
2
SARASOTA
BANK
3-
PALMER
CANK
4
DRNE
IN
5
CITIZENS
+POST
O
R
DOOR-TO-
DOOR
GY
DENS
43076