Human Generated Data

Title

Untitled (large family portrait, outside)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16511

Human Generated Data

Title

Untitled (large family portrait, outside)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.4
Human 99.4
Person 99.2
Person 99.2
Person 99.1
Person 98.9
Person 98.7
Person 97
Person 96.6
Person 96.1
Person 95.2
Apparel 94.1
Shorts 94.1
Clothing 94.1
Person 92.2
Person 91.2
Person 90.6
Person 87.3
People 83.4
Person 82.5
Drawing 82.2
Art 82.2
Outdoors 71.2
Person 70.3
Nature 66.5
Person 62.4
Female 59.1
Duel 58
Sketch 56.6

Imagga
created on 2022-02-11

beach 38.3
sand 32.2
swimsuit 24.5
summer 24.4
sky 24.2
water 24
ocean 23.8
sea 22.7
vacation 22.1
people 21.2
man 20.2
sport 19.2
garment 18.8
silhouette 18.2
person 17.7
sun 16.9
outdoors 16.6
male 15.6
swimming trunks 15.5
sunset 15.3
coast 15.3
clothing 15.1
waves 14.9
couple 14.8
travel 14.1
lifestyle 13.7
leisure 13.3
outdoor 13
tropical 12.8
fun 12.7
athlete 12.3
walking 12.3
landscape 11.9
active 11.9
family 11.6
child 10.8
tourism 10.7
sunlight 10.7
shore 10.2
holiday 10
old 9.8
together 9.6
bikini 9.5
walk 9.5
kin 9.5
happiness 9.4
happy 9.4
art 9.1
daily 8.9
father 8.8
boy 8.7
run 8.7
love 8.7
swim 8.7
wave 8.6
sunny 8.6
men 8.6
covering 8.6
coastline 8.5
clouds 8.4
black 8.4
relaxing 8.2
wind instrument 8.2
life 8.1
recreation 8.1
group 8.1
mother 8
women 7.9
day 7.8
maillot 7.8
play 7.8
brass 7.7
running 7.7
adult 7.5
tourist 7.4
runner 7.3
musical instrument 7.2
scenic 7

Google
created on 2022-02-11

Art 84.9
Painting 84.8
Adaptation 79.3
Illustration 73.3
Drawing 71.9
Visual arts 69.4
Font 67.1
Event 67.1
History 66.8
Paper product 66.5
Monochrome 63.5
Vintage clothing 63.2
Stock photography 62.2
Sketch 58.4
Artwork 57.1
Pole 55.5
Room 53.7
Paper 50.5
Landscape 50.4

Microsoft
created on 2022-02-11

outdoor 95.6
text 93.4
person 90.2
clothing 86
group 78.7
posing 78.5
people 78.3
drawing 72.8
man 71.3
team 37.9

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 68.8%
Calm 98.2%
Confused 0.7%
Sad 0.5%
Surprised 0.4%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Female, 72.7%
Calm 68.5%
Happy 18.8%
Sad 4.4%
Surprised 2.6%
Confused 2.4%
Angry 1.3%
Disgusted 1.1%
Fear 0.8%

AWS Rekognition

Age 49-57
Gender Male, 61.7%
Calm 90.6%
Sad 7.3%
Surprised 0.7%
Disgusted 0.5%
Happy 0.4%
Angry 0.4%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Female, 89.1%
Happy 44.8%
Surprised 29.9%
Calm 18.7%
Disgusted 2.4%
Sad 1.7%
Angry 1.1%
Fear 0.7%
Confused 0.6%

AWS Rekognition

Age 34-42
Gender Male, 99.7%
Calm 69.7%
Happy 9.1%
Sad 5.5%
Angry 5%
Disgusted 4.1%
Surprised 3.1%
Confused 2.1%
Fear 1.4%

AWS Rekognition

Age 45-53
Gender Male, 99.2%
Calm 96.9%
Fear 0.9%
Sad 0.6%
Disgusted 0.5%
Confused 0.3%
Happy 0.3%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 23-33
Gender Male, 93.2%
Calm 97%
Sad 1.2%
Happy 0.9%
Disgusted 0.2%
Confused 0.2%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 47-53
Gender Male, 94.3%
Calm 38%
Happy 33%
Sad 18.8%
Angry 4%
Confused 2.1%
Disgusted 1.8%
Surprised 1.6%
Fear 0.7%

AWS Rekognition

Age 50-58
Gender Female, 81.2%
Confused 40.2%
Calm 31%
Happy 7.4%
Disgusted 5.6%
Sad 5.3%
Angry 4.3%
Fear 3.7%
Surprised 2.5%

AWS Rekognition

Age 51-59
Gender Male, 87.9%
Happy 52.3%
Calm 39.1%
Sad 2.1%
Confused 1.7%
Fear 1.6%
Surprised 1.4%
Disgusted 1.2%
Angry 0.6%

AWS Rekognition

Age 42-50
Gender Female, 54.7%
Sad 36.1%
Calm 23.2%
Angry 19.9%
Confused 8.1%
Happy 7.4%
Disgusted 2.2%
Fear 1.8%
Surprised 1.2%

AWS Rekognition

Age 28-38
Gender Female, 99.8%
Happy 57.5%
Disgusted 20.3%
Sad 10.6%
Angry 5.6%
Surprised 3.2%
Fear 1.2%
Calm 1%
Confused 0.6%

AWS Rekognition

Age 19-27
Gender Female, 82.3%
Calm 85.9%
Fear 6.8%
Sad 4.1%
Happy 1%
Angry 0.9%
Surprised 0.5%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 47-53
Gender Male, 98.7%
Sad 91.6%
Calm 4.7%
Angry 1.3%
Happy 1.2%
Disgusted 0.4%
Fear 0.3%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 38-46
Gender Female, 96.3%
Sad 59.7%
Calm 18.3%
Angry 11.6%
Happy 6.2%
Disgusted 1.4%
Fear 1.1%
Confused 1%
Surprised 0.7%

AWS Rekognition

Age 12-20
Gender Male, 83.1%
Sad 45.8%
Surprised 25.7%
Fear 13.1%
Calm 9.9%
Disgusted 2.1%
Angry 1.5%
Happy 1.4%
Confused 0.5%

AWS Rekognition

Age 51-59
Gender Female, 85.5%
Calm 55.9%
Happy 31.9%
Surprised 4.1%
Confused 2.8%
Sad 1.8%
Disgusted 1.6%
Angry 1.1%
Fear 0.8%

AWS Rekognition

Age 38-46
Gender Male, 98.9%
Happy 97.2%
Calm 1.6%
Fear 0.4%
Sad 0.3%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 38-46
Gender Female, 95.2%
Calm 50.2%
Sad 27.1%
Happy 12.7%
Surprised 2.9%
Fear 2.5%
Angry 1.7%
Disgusted 1.6%
Confused 1.2%

AWS Rekognition

Age 30-40
Gender Male, 67.5%
Calm 61.5%
Happy 28%
Sad 7.2%
Fear 1.1%
Disgusted 0.7%
Surprised 0.6%
Angry 0.6%
Confused 0.2%

AWS Rekognition

Age 25-35
Gender Female, 78.1%
Calm 76.2%
Sad 19.3%
Happy 2%
Angry 0.7%
Confused 0.6%
Fear 0.4%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 35-43
Gender Male, 97.3%
Calm 90.4%
Happy 7.3%
Sad 0.6%
Surprised 0.5%
Fear 0.5%
Angry 0.3%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 40-48
Gender Male, 96.4%
Happy 97.1%
Fear 0.8%
Calm 0.7%
Sad 0.6%
Surprised 0.4%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 35-43
Gender Female, 74.1%
Happy 87.7%
Calm 7.9%
Fear 1.3%
Surprised 1.3%
Sad 0.6%
Confused 0.5%
Disgusted 0.4%
Angry 0.4%

AWS Rekognition

Age 35-43
Gender Female, 86.3%
Calm 85.7%
Surprised 4.5%
Sad 4.1%
Confused 2.2%
Disgusted 1.2%
Happy 0.9%
Angry 0.7%
Fear 0.7%

AWS Rekognition

Age 23-33
Gender Female, 54.1%
Happy 89.4%
Sad 5.2%
Surprised 1.5%
Fear 1.2%
Calm 1.1%
Angry 0.8%
Confused 0.5%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people posing for a photo 97%
a group of people posing for a picture 96.9%
a group of people posing for the camera 96.8%

Text analysis

Amazon

KODAK-EITW

Google

MJI7--YT A AGO
MJI7--YT
A
AGO