Human Generated Data

Title

Untitled (portrait of a large family gathered in front of fence and tree)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2265

Human Generated Data

Title

Untitled (portrait of a large family gathered in front of fence and tree)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Human 99.7
Person 99.7
Person 99.6
Person 99.6
Person 99.5
Person 99.3
Grass 99.1
Plant 99.1
Clothing 97.4
Apparel 97.4
Person 96.5
People 95.9
Person 95.4
Yard 94.5
Outdoors 94.5
Nature 94.5
Person 94.2
Accessories 93.8
Accessory 93.8
Tie 93.8
Face 93.8
Person 87.1
Person 85.6
Person 84.3
Tree 82.1
Park 80.7
Lawn 80.7
Person 77.1
Dress 76.2
Person 75.9
Female 75.6
Suit 73.4
Overcoat 73.4
Coat 73.4
Person 72.4
Kid 70.2
Child 70.2
Photo 69.6
Photography 69.6
Portrait 68.5
Person 65.8
Crowd 65.4
Pants 64.8
Food 63.6
Meal 63.6
Person 62.1
Girl 61.5
Family 59.8
Shorts 57.9
Field 57.4
Animal 57.4
Canine 57.4
Mammal 57.4
Person 53.5

Imagga
created on 2022-01-30

man 28.9
child 27
people 26.2
kin 25.3
male 24.2
person 21.1
happiness 20.4
fun 20.2
sport 20.1
men 19.7
happy 19.4
couple 19.2
boy 19.1
adult 18
active 17.5
outdoors 17.2
together 16.6
silhouette 16.5
love 15.8
sibling 15.7
portrait 15.5
athlete 15.2
smiling 14.5
world 13.8
outdoor 13.8
summer 13.5
grass 13.4
family 13.3
group 12.9
playing 12.8
beach 12.6
park 12.3
lifestyle 12.3
children 11.8
leisure 11.6
youth 11.1
player 11
field 10.9
father 10.8
team 10.7
brother 10
exercise 10
sunset 9.9
activity 9.8
success 9.7
run 9.6
play 9.5
joy 9.2
mother 9.2
competition 9.1
girls 9.1
fashion 9
fitness 9
contestant 8.9
son 8.8
daughter 8.8
practice 8.7
women 8.7
water 8.7
walk 8.6
walking 8.5
friendship 8.4
action 8.3
healthy 8.2
cheerful 8.1
businessman 7.9
ball 7.8
running 7.7
bride 7.7
sky 7.6
art 7.6
enjoying 7.6
togetherness 7.5
kids 7.5
enjoy 7.5
vacations 7.5
friends 7.5
runner 7.4
dad 7.3
freedom 7.3
dress 7.2
life 7.2
black 7.2
teacher 7.2
smile 7.1

Google
created on 2022-01-30

Plant 85.6
Tree 83.4
Grass 80
Font 79.7
Adaptation 79.3
Monochrome 74.3
Vintage clothing 74.2
Monochrome photography 73.2
Photo caption 72.1
Child 71.3
Room 70.8
Toddler 65.6
Art 65.4
Fun 63.4
Happy 62.9
Visual arts 60.7
History 58.4
Photographic paper 58
Team 57.9
Suit 55.2

Microsoft
created on 2022-01-30

outdoor 94.5
posing 90.4
text 90.2
person 84.3
old 74.4
black 73.3
group 71.2
dog 66.1
clothing 66
white 62.7
man 59.7
team 36.9
vintage 28.4

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Female, 70.2%
Calm 80%
Sad 13.9%
Happy 5.2%
Confused 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Male, 91.6%
Calm 81.7%
Happy 14.2%
Sad 1.5%
Fear 1.1%
Disgusted 0.7%
Surprised 0.4%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 24-34
Gender Female, 95.6%
Happy 77.1%
Calm 9.7%
Surprised 9.1%
Fear 1.3%
Sad 0.9%
Angry 0.7%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 40-48
Gender Female, 53.1%
Calm 55.7%
Sad 32%
Confused 4.2%
Happy 2.9%
Angry 1.5%
Disgusted 1.5%
Surprised 1.4%
Fear 0.9%

AWS Rekognition

Age 51-59
Gender Male, 98.9%
Calm 99.1%
Sad 0.4%
Happy 0.3%
Surprised 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 40-48
Gender Female, 87.9%
Happy 78.8%
Calm 16.4%
Surprised 4.3%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 48-56
Gender Female, 84.9%
Calm 72.4%
Happy 19%
Disgusted 3.6%
Sad 2.3%
Confused 1.3%
Angry 0.9%
Surprised 0.3%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.4%
Calm 97.5%
Sad 1.1%
Happy 0.6%
Confused 0.3%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 40-48
Gender Female, 52.9%
Calm 91.6%
Confused 3.2%
Sad 2.5%
Happy 1.3%
Angry 0.5%
Surprised 0.5%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Female, 89.9%
Calm 97.2%
Sad 2%
Happy 0.5%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0%
Confused 0%

AWS Rekognition

Age 47-53
Gender Male, 91.8%
Happy 78.5%
Calm 19.3%
Sad 0.9%
Fear 0.6%
Surprised 0.3%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 45-53
Gender Male, 71.4%
Calm 99.9%
Happy 0.1%
Surprised 0%
Sad 0%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Female, 59%
Happy 71.1%
Calm 28.2%
Sad 0.3%
Surprised 0.2%
Confused 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Female, 57.2%
Calm 90.8%
Happy 6%
Sad 1.3%
Confused 0.7%
Fear 0.4%
Angry 0.3%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 48-54
Gender Male, 98.1%
Happy 97%
Calm 1.6%
Surprised 0.9%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%
Sad 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 93.8%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 94.6%
a vintage photo of a group of people posing for a picture 94.5%
a group of people posing for a photo 94.4%