Human Generated Data

Title

Untitled (elderly women wearing hats at DAR meeting, woman speaking to group)
Date

1948
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15638.2

Human Generated Data

Title

Untitled (elderly women wearing hats at DAR meeting, woman speaking to group)

People

Artist: Jack Gould, American

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Human 99.4
Person 99.4
Person 98.9
Person 98.7
Person 90.8
Furniture 89.8
Room 78.4
Indoors 78.4
Table 67.2
Clinic 67
Electronics 60.3
Screen 60.3
Sitting 59.2
Classroom 55.5
School 55.5
Person 42.8

Imagga
created on 2022-03-25

man 35.6
room 34.5
office 32.9
chair 31.7
people 31.3
male 29.8
sitting 27.5
table 26.2
person 26.1
indoors 25.5
hospital 24.8
home 23.9
barbershop 23.9
adult 23.4
computer 22.5
shop 21.8
smiling 21
barber chair 20.7
business 20.7
clinic 19.9
desk 19.9
women 19
interior 18.6
furniture 18.1
meeting 17.9
businessman 17.7
happy 17.6
men 17.2
senior 16.9
together 16.7
lifestyle 16.6
seat 16.6
work 16.5
team 16.1
modern 16.1
working 15.9
mercantile establishment 15.8
couple 15.7
restaurant 15.5
smile 15
laptop 14.7
indoor 14.6
classroom 14.5
mature 14
group 13.7
portrait 12.9
worker 12.7
businesswoman 12.7
technology 12.6
patient 12.6
teamwork 12.1
kitchen 12
house 11.7
colleagues 11.7
talking 11.4
happiness 11
professional 10.7
two people 10.7
hairdresser 10.7
executive 10.7
place of business 10.7
businesspeople 10.4
looking 10.4
corporate 10.3
casual 10.2
two 10.2
communication 10.1
holding 9.9
cheerful 9.8
window 9.6
elderly 9.6
workplace 9.5
color 9.5
light 9.4
coffee 9.3
inside 9.2
monitor 9.2
suit 9
living room 8.8
love 8.7
togetherness 8.5
design 8.4
attractive 8.4
drink 8.4
service 8.3
occupation 8.3
confident 8.2
food 7.9
casual clothing 7.8
conference 7.8
glass 7.8
pretty 7.7
old 7.7
formal 7.6
horizontal 7.5
friends 7.5
keyboard 7.5
care 7.4
nurse 7.3
cup 7.2
furnishing 7.1
romantic 7.1
to 7.1
job 7.1
medical 7.1

Google
created on 2022-03-25

Table 92.6
Chair 79.8
Writing desk 78.7
Suit 77.9
Art 77.8
Hat 75.7
Monochrome 75.1
Vintage clothing 72.4
Room 70.2
Monochrome photography 70.1
Curtain 69.5
Desk 65.8
Stock photography 63
History 60.7
Sitting 58.6
Employment 57.5
Job 56.4
Illustration 55.2
White-collar worker 53.4
Retro style 52.5

Microsoft
created on 2022-03-25

table 98.3
furniture 96.9
person 95.3
indoor 95.3
wall 95
text 85.8
window 81.3
clothing 76.4
desk 67.9
chair 63.8
house 52.2
family 51.7
old 47.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Female, 69.4%
Calm 97.1%
Sad 1.7%
Disgusted 0.4%
Angry 0.4%
Surprised 0.2%
Fear 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 66-76
Gender Female, 99.9%
Calm 92.3%
Confused 1.8%
Sad 1.6%
Angry 1.5%
Surprised 1.1%
Happy 0.8%
Disgusted 0.6%
Fear 0.3%

AWS Rekognition

Age 54-62
Gender Male, 98.7%
Sad 45.5%
Confused 25.1%
Disgusted 11.7%
Calm 8.4%
Angry 3.5%
Surprised 2.8%
Fear 1.9%
Happy 1%

AWS Rekognition

Age 61-71
Gender Female, 99.6%
Calm 73.9%
Happy 9.6%
Confused 5.4%
Disgusted 4.5%
Angry 2.2%
Surprised 1.8%
Sad 1.7%
Fear 0.9%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Surprised 77.5%
Confused 11.8%
Calm 5.5%
Sad 2.6%
Fear 1.7%
Angry 0.7%
Disgusted 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 56
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 61
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people sitting at a table 94.8%
a group of people sitting around a table 94.7%
a person sitting at a table 94.6%

Text analysis

Amazon

FAIRVIEW
City
JOBE
AVE.
1336 FAIRVIEW AVE.
PAUL JOBE
M
PAUL
1336
UNIVERSITY City 14 M
14
UNIVERSITY

Google

FAIRVIE
AVE.
Ey
M
Pau JosE 1336 FAIRVIE W AVE. Ey Cy M
Pau
W
JosE
1336
Cy