Human Generated Data

Title

Untitled (portrait of a large family gathered in front of fence and tree)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2264

Human Generated Data

Title

Untitled (portrait of a large family gathered in front of fence and tree)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Person 99.6
Human 99.6
Person 99.5
Person 99.4
Person 99.3
Person 98.9
Apparel 97
Clothing 97
Grass 96.7
Plant 96.7
Shorts 94
Outdoors 93.7
Yard 93.7
Nature 93.7
Person 93.5
Face 93.4
Person 92.3
Person 92.3
People 90.9
Person 89.9
Person 89.6
Female 85.9
Play 84.4
Tree 82
Person 81.6
Accessories 81.6
Tie 81.6
Accessory 81.6
Dress 78.3
Person 75.7
Meal 74.7
Food 74.7
Child 71.9
Kid 71.9
Person 71.2
Girl 70.6
Person 68.5
Crowd 67.9
Person 66.7
Portrait 66.5
Photography 66.5
Photo 66.5
Person 66.4
Person 63.6
Person 62
Coat 59.4
Suit 59.4
Overcoat 59.4
Woman 59.1
Park 58.6
Lawn 58.6
Leisure Activities 58.3
Chair 57
Furniture 57
Vacation 55.1
Picnic 55.1
Person 54.8
Person 50.9

Imagga
created on 2022-01-30

silhouette 29
kin 27.4
man 26.9
people 25.6
sport 24.7
athlete 23.7
male 23.4
world 22.3
person 19.7
field 18.4
team 17.9
group 17.7
competition 17.4
crowd 17.3
child 16.7
player 15.9
ball 15.2
training 14.8
stadium 14.6
kick 14.6
men 14.6
football 14.4
adult 14.1
couple 13.9
happy 13.8
audience 13.6
fun 13.5
symbol 13.5
goal 13.4
boy 13
outdoor 13
lights 13
teamwork 13
match 12.5
happiness 12.5
patriotic 12.5
park 12.3
nation 12.3
together 12.3
flag 12
event 12
playing 11.8
sunset 11.7
championship 11.7
skill 11.5
soccer 11.5
active 11.1
grass 11.1
pass 10.7
shoot 10.6
run 10.6
outdoors 10.5
muscular 10.5
portrait 10.3
friendship 10.3
icon 10.3
love 10.3
cheering 9.8
design 9.6
friends 9.4
girls 9.1
global 9.1
summer 9
family 8.9
success 8.8
businessman 8.8
lifestyle 8.7
play 8.6
walk 8.6
walking 8.5
business 8.5
dark 8.3
dance 8.3
fashion 8.3
activity 8.1
sun 8
water 8
smiling 8
women 7.9
bright 7.9
nighttime 7.8
boys 7.7
attractive 7.7
youth 7.7
enjoy 7.5
dog 7.5
joy 7.5
teenager 7.3
children 7.3
sexy 7.2
copy space 7.2
black 7.2

Google
created on 2022-01-30

Vertebrate 91.9
Mammal 86
Font 81.7
Tree 81.3
Grass 79.9
Adaptation 79.4
Vintage clothing 76.6
Monochrome 76.2
Monochrome photography 73.1
Photo caption 71.2
Room 70.6
Fun 69.2
Plant 67.3
Child 66.6
Stock photography 62
Photographic paper 59.4
Team 58.4
Toddler 57.5
Crew 56.7
History 56.5

Microsoft
created on 2022-01-30

tree 97.5
text 95.4
outdoor 95.2
person 94.8
posing 89.1
clothing 86.6
man 76.7
black 70.4
group 66.4
old 65.2
white 60.3
vintage 30.2

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Female, 52.9%
Calm 72.5%
Happy 18.9%
Confused 2.1%
Sad 1.9%
Fear 1.9%
Surprised 1.6%
Disgusted 0.6%
Angry 0.5%

AWS Rekognition

Age 43-51
Gender Female, 94.5%
Calm 54.8%
Happy 43.5%
Surprised 1.1%
Angry 0.2%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 27-37
Gender Female, 91.9%
Calm 76.4%
Sad 11.8%
Happy 8.4%
Disgusted 0.9%
Fear 0.9%
Confused 0.8%
Surprised 0.4%
Angry 0.4%

AWS Rekognition

Age 53-61
Gender Male, 95.5%
Calm 99.6%
Sad 0.2%
Surprised 0.1%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 39-47
Gender Female, 90.2%
Calm 85.3%
Happy 7.4%
Sad 2.5%
Surprised 2.2%
Fear 1.5%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 48-56
Gender Male, 96.6%
Sad 49%
Calm 37.3%
Happy 7.5%
Angry 1.8%
Confused 1.4%
Fear 1.3%
Surprised 0.9%
Disgusted 0.9%

AWS Rekognition

Age 49-57
Gender Female, 54%
Calm 95%
Happy 3.6%
Sad 0.6%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 26-36
Gender Female, 84.5%
Happy 98%
Calm 1.3%
Sad 0.3%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 47-53
Gender Female, 99.6%
Sad 58.9%
Calm 19.9%
Happy 13%
Disgusted 2.3%
Confused 1.8%
Fear 1.5%
Surprised 1.3%
Angry 1.1%

AWS Rekognition

Age 48-54
Gender Female, 82.7%
Happy 60.7%
Calm 24.8%
Surprised 12.8%
Sad 0.5%
Disgusted 0.4%
Fear 0.4%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 34-42
Gender Female, 99.5%
Calm 55.8%
Sad 16.3%
Happy 14.6%
Surprised 7.6%
Fear 1.8%
Confused 1.7%
Disgusted 1.2%
Angry 0.9%

AWS Rekognition

Age 43-51
Gender Female, 71.5%
Happy 84.9%
Calm 11.1%
Surprised 2%
Angry 0.6%
Disgusted 0.5%
Fear 0.3%
Sad 0.3%
Confused 0.2%

AWS Rekognition

Age 45-53
Gender Male, 97.9%
Calm 98.2%
Happy 1.2%
Sad 0.2%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 52-60
Gender Female, 99.2%
Happy 98.9%
Surprised 0.7%
Calm 0.2%
Fear 0%
Disgusted 0%
Sad 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 33-41
Gender Female, 61.3%
Happy 56.1%
Calm 27.8%
Sad 7.8%
Fear 4.2%
Surprised 1.6%
Angry 1.5%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 47-53
Gender Female, 84.5%
Happy 81%
Calm 15.6%
Sad 1.2%
Fear 0.8%
Angry 0.6%
Confused 0.3%
Surprised 0.3%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 81.6%

Captions

Microsoft

a vintage photo of a group of people posing for a picture 96.5%
a vintage photo of a group of people posing for the camera 95.9%
a group of people posing for a photo 95.8%