Human Generated Data

Title

Untitled (portrait of Mary Brown with children, outside)

Date

1955

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17826

Human Generated Data

Title

Untitled (portrait of Mary Brown with children, outside)

People

Artist: Lucian and Mary Brown, American

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.7
Person 99.7
Person 99
Clothing 99
Apparel 99
Person 98.1
Person 97.3
Person 96.5
Person 95.8
Person 89.2
People 82.5
Grass 77.7
Plant 77.7
Female 76.9
Suit 74.9
Coat 74.9
Overcoat 74.9
Shorts 73.5
Face 66.8
Photography 65
Photo 65
Sleeve 65
Portrait 63.8
Cricket 58.8
Sport 58.8
Sports 58.8

Imagga
created on 2022-02-26

silhouette 27.3
person 26.1
man 24.9
people 24.5
sunset 19.8
sky 18.5
light 16.7
player 15.9
sport 15.8
male 15.6
active 15
black 14.4
cricket equipment 14.1
dark 13.4
cricket bat 13.3
adult 13.2
outdoor 13
sports equipment 12.8
world 12.5
summer 12.2
happiness 11.7
symbol 11.4
happy 11.3
beach 11.1
sun 10.8
water 10.7
crowd 10.6
equipment 10.5
sax 10.3
sea 10.2
freedom 10.1
exercise 10
performer 9.9
outdoors 9.7
landscape 9.7
couple 9.6
design 9.6
athlete 9.5
love 9.5
men 9.4
lifestyle 9.4
training 9.2
field 9.2
musical instrument 9.1
park 9.1
wind instrument 9
vibrant 8.8
boy 8.7
standing 8.7
golfer 8.5
evening 8.4
smoke 8.4
hand 8.4
color 8.3
event 8.3
ocean 8.3
danger 8.2
fitness 8.1
group 8.1
night 8
women 7.9
bright 7.9
destruction 7.8
wicket 7.7
motion 7.7
outside 7.7
contestant 7.6
stage 7.5
sign 7.5
fun 7.5
clothing 7.4
glowing 7.4
competition 7.3
lady 7.3
protection 7.3
industrial 7.3
body 7.2
life 7.1
businessman 7.1
together 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

posing 96.4
text 95.1
person 84.7
clothing 82.2
standing 82
man 75.1
old 71.1
tree 61.3

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Female, 92%
Calm 98.5%
Happy 1.3%
Surprised 0%
Disgusted 0%
Confused 0%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Female, 68.5%
Calm 98.9%
Sad 0.5%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 38-46
Gender Female, 86.3%
Happy 53.9%
Calm 24.2%
Sad 11.6%
Surprised 3.6%
Angry 2.5%
Fear 1.9%
Confused 1.3%
Disgusted 1.2%

AWS Rekognition

Age 38-46
Gender Female, 91.6%
Happy 62.5%
Calm 30.9%
Sad 2.7%
Surprised 1.1%
Angry 1.1%
Fear 1%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 42-50
Gender Male, 95%
Happy 94.7%
Calm 3.1%
Surprised 0.8%
Angry 0.7%
Disgusted 0.3%
Sad 0.3%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Female, 70%
Calm 89.1%
Sad 5.5%
Happy 2.7%
Confused 1.2%
Disgusted 0.5%
Surprised 0.3%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 22-30
Gender Male, 76.8%
Sad 79.7%
Calm 17.4%
Confused 1.4%
Angry 0.4%
Fear 0.4%
Surprised 0.3%
Happy 0.3%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a vintage photo of a group of people posing for a picture 92%
a vintage photo of a group of people posing for the camera 90.5%
a group of people posing for a photo 90.4%

Text analysis

Google

MJI7--YT 3RA°2 - - XAGO
MJI7--YT
3RA°2
-
XAGO