Human Generated Data

Title

Untitled (portrait of family on stairs)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17721

Human Generated Data

Title

Untitled (portrait of family on stairs)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.3
Human 99.3
Person 99.2
Person 99.1
Person 98.2
Person 97.7
Person 97.2
Person 96.3
Person 93.7
Person 87.6
Clothing 87.1
Apparel 87.1
People 78.1
Face 72.2
Nature 60.1
Clinic 59.3
Outdoors 57.5
Coat 56.8
Photography 56.4
Photo 56.4

Imagga
created on 2022-02-26

people 27.9
person 24.8
negative 20.8
man 20.8
male 18.4
film 17
team 17
love 15.8
couple 15.7
business 15.2
work 14.9
happiness 14.9
teamwork 14.8
sexy 14.4
crowd 14.4
adult 14.3
nation 14.2
businessman 14.1
silhouette 14.1
symbol 13.5
kin 13.3
picket fence 13.1
women 12.6
art 12.6
happy 12.5
patriotic 12.5
photographic paper 12.4
life 12.2
flag 12.1
job 11.5
design 11.2
human 11.2
celebration 11.2
world 11.1
businesswoman 10.9
nighttime 10.8
icon 10.3
presentation 10.2
fence 10.2
sky 10.2
lights 10.2
star 10.1
smile 10
supporters 9.9
president 9.8
cheering 9.8
speech 9.8
cheerful 9.7
audience 9.7
stadium 9.7
glass 9.7
leader 9.6
vibrant 9.6
boss 9.6
white 9.3
joy 9.2
occupation 9.2
child 9.1
dress 9
science 8.9
group 8.9
hair 8.7
smiling 8.7
men 8.6
bright 8.6
marriage 8.5
portrait 8.4
attractive 8.4
fashion 8.3
photographic equipment 8.3
outdoors 8.2
graphic 8
groom 7.9
bride 7.9
husband 7.8
barrier 7.8
party 7.7
summer 7.7
cross 7.5
map 7.5
bass 7.5
globe 7.4
professional 7.4
holiday 7.2
face 7.1
working 7.1
day 7.1
together 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 97.4
drawing 96.2
clothing 91.8
person 91.2
cartoon 83.7
sketch 81
posing 80
human face 68.3
man 50.1
old 46.3

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 99.9%
Happy 79.2%
Surprised 15.7%
Angry 1.3%
Disgusted 1.2%
Fear 1.2%
Sad 0.8%
Confused 0.3%
Calm 0.3%

AWS Rekognition

Age 19-27
Gender Male, 79%
Surprised 97.6%
Calm 1.5%
Happy 0.6%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Female, 57.5%
Calm 52.1%
Happy 25.7%
Disgusted 7.3%
Sad 6.9%
Confused 4.4%
Surprised 2.2%
Angry 0.8%
Fear 0.7%

AWS Rekognition

Age 29-39
Gender Female, 64.7%
Happy 83.2%
Surprised 6.9%
Sad 2.6%
Disgusted 2.4%
Confused 2%
Calm 1.3%
Angry 0.8%
Fear 0.8%

AWS Rekognition

Age 42-50
Gender Male, 99.6%
Happy 62.2%
Surprised 34.2%
Calm 1%
Disgusted 0.7%
Confused 0.7%
Fear 0.6%
Sad 0.4%
Angry 0.2%

AWS Rekognition

Age 29-39
Gender Male, 98%
Surprised 46.1%
Calm 36.5%
Happy 13.5%
Fear 1%
Angry 1%
Confused 0.7%
Sad 0.7%
Disgusted 0.5%

AWS Rekognition

Age 12-20
Gender Female, 76.3%
Calm 84.3%
Happy 8.5%
Surprised 5.8%
Sad 0.4%
Disgusted 0.3%
Angry 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Happy 81.7%
Surprised 9.9%
Sad 2.9%
Disgusted 2.7%
Fear 1.1%
Confused 0.6%
Calm 0.6%
Angry 0.5%

AWS Rekognition

Age 28-38
Gender Female, 87.1%
Happy 81.7%
Calm 15%
Surprised 1.6%
Sad 0.8%
Disgusted 0.5%
Confused 0.3%
Angry 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people posing for a photo 90.6%
a group of people posing for the camera 90.5%
a group of people posing for a picture 90.4%

Text analysis

Amazon

2
LFR
69

Google

YT3
--
MJI3
A2
AGON
MJI3--YT3マA2--AGON