Human Generated Data

Title

Untitled (woman holding book, in front of large group)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16714

Human Generated Data

Title

Untitled (woman holding book, in front of large group)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.5
Apparel 99.5
Person 99.3
Human 99.3
Person 99.2
Person 99
Person 98.5
Person 98.2
Person 98
Dress 97.8
Person 96.9
Person 96.5
Shoe 92.4
Footwear 92.4
Robe 86.6
Fashion 86.6
Gown 86.4
Person 85.1
Wedding 81.7
Female 80.7
Appliance 77.1
Ceiling Fan 77.1
People 76.5
Person 75.7
Lamp 74.9
Person 74
Evening Dress 71.5
Person 68.3
Wedding Gown 66.2
Photo 65.2
Photography 65.2
Person 65
Face 64.9
Portrait 64.9
Woman 63.1
Chandelier 59.2
Indoors 59.1
Suit 56.5
Coat 56.5
Overcoat 56.5
Bride 55.1

Imagga
created on 2022-02-26

flag 21.1
design 17.4
business 16.4
blackboard 16
art 15.8
decoration 15.3
people 15
world 13.7
person 13.3
interior 13.3
ripple 12.4
graphic 12.4
life 12.3
sign 12
man 11.4
drawing 10.8
emblem 10.8
symbol 10.8
wide 10.5
adult 10.4
old 10.4
party 10.3
grunge 10.2
light 10
room 10
waving 9.7
home 9.6
state 9.6
teacher 9.5
nation 9.5
men 9.4
fabric 9.4
commerce 9.3
clip 9.3
house 9.2
modern 9.1
silhouette 9.1
national 9.1
wall 9
pattern 8.9
domain 8.9
rippling 8.8
patriotism 8.7
women 8.7
wavy 8.7
patriotic 8.6
male 8.5
website 8.5
web 8.5
two 8.5
site 8.4
retro 8.2
technology 8.2
sketch 8.1
celebration 8
decor 8
users 7.9
country 7.9
homepage 7.9
dancer 7.8
e commerce 7.8
table 7.8
search 7.7
motion 7.7
elegant 7.7
navigation 7.7
flower 7.7
finance 7.6
window 7.4
style 7.4
professional 7.4
glass 7.3
group 7.2
color 7.2
paper 7.2

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

wedding dress 98.2
bride 96
text 95.9
dress 92.7
woman 78.1
wedding 78
clothing 69.3
person 68.7
old 45.3
posing 35.7

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 96.4%
Calm 94.4%
Happy 3.7%
Confused 0.7%
Surprised 0.4%
Sad 0.3%
Disgusted 0.2%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 28-38
Gender Male, 96.8%
Calm 86.1%
Confused 9%
Sad 3.5%
Surprised 0.4%
Disgusted 0.4%
Fear 0.2%
Happy 0.2%
Angry 0.2%

AWS Rekognition

Age 28-38
Gender Male, 98.4%
Sad 49.3%
Calm 20.8%
Happy 13.7%
Disgusted 4.5%
Fear 3.7%
Angry 3.4%
Confused 3%
Surprised 1.6%

AWS Rekognition

Age 27-37
Gender Male, 95.5%
Sad 91.9%
Calm 5.3%
Confused 1.4%
Fear 0.7%
Happy 0.3%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 4-12
Gender Male, 90.7%
Sad 95.7%
Happy 3%
Confused 0.4%
Fear 0.3%
Calm 0.3%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.2%
Sad 92.5%
Confused 2.5%
Calm 2.4%
Happy 0.6%
Surprised 0.6%
Fear 0.5%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 10-18
Gender Female, 99.8%
Sad 49.4%
Calm 45.2%
Happy 1.3%
Angry 0.9%
Confused 0.9%
Fear 0.8%
Surprised 0.8%
Disgusted 0.6%

AWS Rekognition

Age 19-27
Gender Female, 99.2%
Calm 39.2%
Happy 25.1%
Sad 22.5%
Fear 5.9%
Angry 2.9%
Surprised 2.2%
Confused 1.5%
Disgusted 0.8%

AWS Rekognition

Age 42-50
Gender Male, 67.8%
Calm 62.4%
Fear 19.9%
Sad 11.5%
Confused 2.2%
Surprised 2.1%
Disgusted 0.8%
Angry 0.7%
Happy 0.4%

AWS Rekognition

Age 23-31
Gender Female, 54.6%
Calm 60.8%
Happy 25.6%
Sad 4.8%
Confused 2.7%
Angry 2.5%
Fear 1.6%
Disgusted 1%
Surprised 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 92.4%
Ceiling Fan 77.1%

Captions

Microsoft

a group of people posing for a photo 75.6%
a group of people posing for a picture 75.5%
an old photo of a man 75.4%

Text analysis

Amazon

5
LIFE
YOUR
I