Human Generated Data

Title

Untitled (father and daughter, Long Beach)

Date

1978

People

Artist: Sharon Smith, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.1723

Human Generated Data

Title

Untitled (father and daughter, Long Beach)

People

Artist: Sharon Smith, American 20th century

Date

1978

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Poster 100
Collage 100
Advertisement 100
Person 97.9
Human 97.9
Person 97.8
Person 97.4
Person 97.1
Person 95.6
Person 95.5
Person 95.2
Person 95
Person 94.4
Person 92.8
Person 92.5
Person 89.4
Person 79.5
Person 79
Person 77.5
Accessory 76
Accessories 76
Sunglasses 76
Person 72.8
Person 71
Art 69.4
Person 63.4
Art Gallery 55.9
Person 46.9
Person 43.9
Person 42.5

Imagga
created on 2022-03-12

design 28.2
card 22.6
art 18.8
frame 18.7
decoration 18
floral 17.9
collection 16.2
flower 16.1
pattern 15.7
insulating material 15.7
banner 14.7
celebration 14.4
cartoon 14.3
symbol 14.1
business 14
old 13.9
set 13.6
retro 13.1
paper 12.9
gift 12.9
holiday 12.9
graphic 12.4
colorful 12.2
building material 12
template 11.9
letter 11.9
vintage 11.6
group 11.3
color 11.1
elegance 10.9
element 10.7
happy 10.7
mail 10.5
modern 10.5
shape 10.3
icon 10.3
blank 10.3
box 10.2
communication 10.1
decorative 10
fashion 9.8
sign 9.8
collage 9.6
stamp 9.6
leaf 9.3
greeting 9.3
birthday 9.3
fun 9
style 8.9
postage 8.9
invitation 8.7
cute 8.6
print 8.5
black 8.4
traditional 8.3
silhouette 8.3
creative 7.9
drawing 7.8
face 7.8
party 7.7
line 7.7
film 7.7
postcard 7.7
post 7.6
web 7.6
bird 7.4
envelope 7.3
people 7.3
women 7.1

Google
created on 2022-03-12

Facial expression 93.3
Mammal 86.4
Organism 86.3
Rectangle 84.8
Art 84.6
Font 83.9
Sleeve 78.1
Happy 71.1
Room 69.6
Visual arts 69.5
Collage 69.2
Pattern 64.3
Stock photography 61.6
Circle 57.3
Collection 53.4

Microsoft
created on 2022-03-12

gallery 98.9
person 90.1
cartoon 89.6
different 86.3
human face 82.3
room 69.1
white 67.8
clothing 63.3
painted 63.3
various 61
woman 58.2
poster 56.5
painting 55
several 33.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-47
Gender Female, 100%
Calm 83.6%
Happy 5.6%
Disgusted 4.4%
Angry 2%
Sad 1.4%
Confused 1.2%
Fear 1%
Surprised 0.9%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 93.5%
Sad 6.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0%
Confused 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 31-41
Gender Female, 98.8%
Confused 57.3%
Angry 36.4%
Calm 2.5%
Disgusted 1.9%
Sad 1.1%
Surprised 0.4%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 35-43
Gender Male, 95.9%
Happy 98.4%
Calm 0.4%
Fear 0.3%
Surprised 0.3%
Sad 0.2%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 54-64
Gender Female, 99.4%
Happy 99.9%
Angry 0%
Surprised 0%
Calm 0%
Sad 0%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 6-12
Gender Male, 89.2%
Happy 99.6%
Confused 0.1%
Sad 0.1%
Disgusted 0%
Angry 0%
Calm 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Female, 98.9%
Happy 99.8%
Angry 0%
Surprised 0%
Confused 0%
Disgusted 0%
Sad 0%
Fear 0%
Calm 0%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 60.9%
Disgusted 13%
Confused 11.2%
Angry 10.9%
Sad 1.7%
Surprised 1%
Fear 0.9%
Happy 0.4%

AWS Rekognition

Age 21-29
Gender Female, 100%
Happy 99.5%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 30-40
Gender Female, 100%
Happy 91.4%
Confused 3.4%
Disgusted 2%
Angry 1.1%
Calm 1.1%
Sad 0.7%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Sad 27.3%
Calm 23.7%
Happy 22%
Angry 9.2%
Surprised 6.2%
Fear 5.5%
Disgusted 3.9%
Confused 2.2%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 100%
Angry 0%
Confused 0%
Happy 0%
Surprised 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Female, 87.8%
Happy 95.1%
Surprised 1.5%
Fear 0.9%
Calm 0.8%
Disgusted 0.7%
Angry 0.4%
Sad 0.3%
Confused 0.3%

AWS Rekognition

Age 21-29
Gender Female, 95%
Calm 49.8%
Surprised 10.7%
Fear 8.6%
Angry 8%
Disgusted 7.5%
Happy 6.1%
Sad 5.6%
Confused 3.7%

AWS Rekognition

Age 18-26
Gender Female, 94.8%
Happy 64.8%
Sad 24.3%
Fear 5.6%
Surprised 1.9%
Calm 1.3%
Angry 0.9%
Disgusted 0.6%
Confused 0.6%

AWS Rekognition

Age 10-18
Gender Female, 99.9%
Calm 49.6%
Happy 33.9%
Fear 8.1%
Confused 2.1%
Sad 2.1%
Surprised 1.9%
Disgusted 1.2%
Angry 0.9%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Angry 60.8%
Sad 21.5%
Calm 11%
Disgusted 3%
Fear 1.5%
Confused 0.8%
Happy 0.7%
Surprised 0.6%

AWS Rekognition

Age 43-51
Gender Female, 100%
Happy 99%
Disgusted 0.6%
Sad 0.1%
Angry 0.1%
Surprised 0%
Confused 0%
Calm 0%
Fear 0%

AWS Rekognition

Age 2-10
Gender Female, 75%
Calm 32.1%
Confused 24.2%
Happy 22.3%
Sad 5.8%
Fear 5.2%
Angry 4.3%
Surprised 3.9%
Disgusted 2.2%

AWS Rekognition

Age 49-57
Gender Male, 98.9%
Calm 99.7%
Happy 0.1%
Angry 0.1%
Fear 0%
Confused 0%
Sad 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 30-40
Gender Female, 99.1%
Angry 32.7%
Calm 19.9%
Sad 13.6%
Disgusted 11.9%
Surprised 7.2%
Happy 5.9%
Confused 4.9%
Fear 3.9%

AWS Rekognition

Age 33-41
Gender Female, 99.7%
Disgusted 35.4%
Angry 25.4%
Calm 23.5%
Confused 6%
Sad 5.5%
Surprised 1.8%
Happy 1.3%
Fear 1.2%

AWS Rekognition

Age 7-17
Gender Male, 99.7%
Happy 49.1%
Angry 26.2%
Sad 13.9%
Calm 6.1%
Surprised 1.4%
Disgusted 1.3%
Fear 1.2%
Confused 0.8%

AWS Rekognition

Age 19-27
Gender Female, 63.5%
Fear 52.4%
Happy 37.4%
Sad 7.5%
Disgusted 0.9%
Surprised 0.8%
Angry 0.5%
Calm 0.3%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Female, 99%
Calm 98.2%
Happy 0.5%
Angry 0.4%
Sad 0.3%
Confused 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 25-35
Gender Female, 100%
Disgusted 80.8%
Happy 10.4%
Angry 3.4%
Calm 2.1%
Surprised 1.3%
Confused 0.9%
Fear 0.7%
Sad 0.5%

AWS Rekognition

Age 24-34
Gender Female, 93.4%
Calm 76.4%
Happy 8.2%
Angry 6.2%
Surprised 2.6%
Sad 2.6%
Fear 1.5%
Disgusted 1.4%
Confused 1.1%

AWS Rekognition

Age 37-45
Gender Male, 70.6%
Calm 91.8%
Angry 3.5%
Sad 1.5%
Happy 1%
Surprised 1%
Fear 0.5%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 16-24
Gender Female, 98.4%
Calm 74.6%
Happy 17%
Sad 3.8%
Angry 1.5%
Disgusted 0.9%
Confused 0.9%
Fear 0.8%
Surprised 0.5%

AWS Rekognition

Age 23-31
Gender Female, 88.9%
Calm 74.6%
Happy 9.6%
Angry 4.1%
Sad 3.6%
Surprised 2.8%
Disgusted 2%
Fear 1.8%
Confused 1.6%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 55
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 97.9%

Captions

Microsoft

many different animals in a room 48.5%
a close up of many different things in the room 48.4%