Human Generated Data

Title

Untitled (woman posing with three grandchildren on couch at Christmas time)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9265

Human Generated Data

Title

Untitled (woman posing with three grandchildren on couch at Christmas time)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.3
Person 99.3
Person 97.4
Clothing 97.1
Apparel 97.1
Person 96.8
Furniture 91.8
Chair 91.8
Helmet 90.9
Couch 89
Suit 88.9
Overcoat 88.9
Coat 88.9
Person 84.4
Female 81.3
People 79.8
Indoors 75.3
Face 70.3
Leisure Activities 68.8
Room 67.9
Dress 66.3
Living Room 66.2
Girl 64.4
Kid 63.8
Child 63.8
Crowd 63.5
Photography 60.5
Photo 60.5
Tuxedo 59.6
Fashion 59.1
Gown 59.1
Woman 58
Monitor 57.6
Electronics 57.6
Screen 57.6
Display 57.6
Robe 56.6
Shorts 55.9
Wedding 55.2

Imagga
created on 2022-01-23

man 38.3
person 34.4
male 33.3
wind instrument 31.3
people 30.7
adult 30.5
teacher 29.5
room 28.9
oboe 27.6
men 25.7
home 23.9
women 22.9
professional 22.2
bassoon 21.6
woodwind 21.5
happy 21.3
couple 20.9
sitting 20.6
indoors 20.2
table 18.2
musical instrument 18.1
senior 17.8
together 17.5
business 17
worker 17
office 16.9
smiling 16.6
lifestyle 16.6
laptop 16.4
educator 16.3
group 16.1
meeting 16
businessman 15.9
brass 15.2
happiness 14.9
businesswoman 14.5
computer 14.4
work 14.1
chair 13.9
patient 13.8
team 13.4
flute 13
smile 12.8
classroom 12.7
family 12.4
talking 12.3
mature 12.1
teamwork 12
casual 11.9
communication 11.7
handsome 11.6
elderly 11.5
businesspeople 11.4
cheerful 11.4
life 11.3
corporate 11.2
nurse 11.1
portrait 11
indoor 11
working 10.6
executive 10.3
two 10.2
alone 10
house 10
care 9.9
education 9.5
student 9.4
study 9.3
successful 9.1
modern 9.1
holding 9.1
health 9
technology 8.9
job 8.8
couch 8.7
living 8.5
desk 8.5
relaxation 8.4
old 8.4
confident 8.2
suit 8.1
looking 8
medical 7.9
love 7.9
living room 7.8
boy 7.8
child 7.8
hall 7.7
attractive 7.7
hospital 7.5
manager 7.4
inside 7.4
lady 7.3
success 7.2
board 7.2
interior 7.1
medicine 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 97.5
clothing 93.6
person 92.8
toddler 75.5
baby 55.8
human face 51.6

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 67.3%
Sad 53.1%
Happy 21.2%
Calm 20.2%
Confused 1.8%
Disgusted 1.4%
Surprised 0.8%
Fear 0.7%
Angry 0.7%

AWS Rekognition

Age 20-28
Gender Male, 92.5%
Calm 93.8%
Sad 4.7%
Happy 0.3%
Confused 0.3%
Angry 0.3%
Fear 0.2%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 9-17
Gender Female, 84.6%
Surprised 87.5%
Calm 8.3%
Angry 1.1%
Sad 0.9%
Fear 0.7%
Disgusted 0.7%
Happy 0.4%
Confused 0.4%

AWS Rekognition

Age 23-33
Gender Male, 94.2%
Calm 99.8%
Surprised 0.1%
Disgusted 0%
Sad 0%
Confused 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Female, 77.6%
Calm 37.7%
Happy 28.5%
Sad 22.5%
Fear 6.6%
Disgusted 1.9%
Angry 1.1%
Confused 1%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Helmet 90.9%

Captions

Microsoft

a group of people sitting next to a window 89.3%
a group of people sitting in front of a window 88.7%
a group of people sitting in chairs in front of a window 88.6%

Text analysis

Amazon

MJI7
YT33A2
MJI7 YT33A2 ОЗНИА
D
ОЗНИА

Google

st
S
st 3 S a ME YT33A2 002MA
3
YT33A2
a
ME
002MA