Human Generated Data

Title

Untitled (family portrait: large group of people on lawn outside house)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16555

Human Generated Data

Title

Untitled (family portrait: large group of people on lawn outside house)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16555

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Shorts 99.9
Clothing 99.9
Apparel 99.9
Person 99.4
Human 99.4
Person 98.8
Person 98.4
Person 98
Person 95.5
Person 95.5
Grass 94.3
Plant 94.3
Person 93.8
Person 90.4
Person 90.3
Person 87.4
Play 86.7
Person 85.4
People 85.4
Person 84.7
Female 84.5
Outdoors 79.2
Tree 75.8
Kid 75.5
Child 75.5
Meal 72
Food 72
Person 71.6
Girl 71.3
Yard 69.8
Nature 69.8
Blonde 69.8
Teen 69.8
Woman 69.8
Dress 66.5
Housing 64.8
Building 64.8
Crowd 63.3
Leisure Activities 60.3
Person 59.3
Field 58.5
Suit 58.3
Coat 58.3
Overcoat 58.3
Person 58.2
Sport 55.2
Sports 55.2
Person 48.4

Clarifai
created on 2023-10-29

people 100
child 99.6
many 99.6
group 99
group together 98.7
boy 98.5
man 97.9
adult 97.3
education 94.2
wear 91.6
several 91.4
school 91.3
uniform 89.8
spectator 87.5
family 87.4
monochrome 87.3
outfit 86
crowd 84.7
recreation 82.4
war 81.6

Imagga
created on 2022-02-12

runner 48.6
athlete 43.2
contestant 29.9
child 27.6
beach 27.2
sport 25.7
man 24.9
person 23.7
people 23.4
silhouette 21.5
male 19.2
sunset 18.9
sea 17.2
walking 17
sand 16.9
adult 16.2
water 15.3
outdoor 15.3
ocean 14.9
summer 14.8
kin 14.7
men 14.6
run 14.5
outdoors 14.3
leisure 13.3
lifestyle 13
portrait 12.9
sky 12.8
exercise 12.7
walk 12.4
vacation 12.3
couple 12.2
boy 12.2
black 12
life 12
women 11.1
love 11
active 10.9
fitness 10.8
happy 10.7
world 10.6
swimming trunks 10.5
fun 10.5
play 10.3
action 10.2
travel 9.9
sunlight 9.8
together 9.6
swimsuit 9.2
family 8.9
group 8.9
sun 8.9
grass 8.7
running 8.6
happiness 8.6
dusk 8.6
youth 8.5
shore 8.4
joy 8.4
street 8.3
coast 8.1
art 7.9
motion 7.7
health 7.6
relax 7.6
landscape 7.4
player 7.4
lake 7.3
recreation 7.2
garment 7.1
businessman 7.1

Google
created on 2022-02-12

Microsoft
created on 2022-02-12

text 97.5
outdoor 97.2
person 95.7
clothing 91.7
team 25.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 80.7%
Calm 82.8%
Happy 7.6%
Sad 6.4%
Confused 1.2%
Surprised 1.1%
Angry 0.4%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 37-45
Gender Female, 99.8%
Calm 56.5%
Happy 41.7%
Surprised 1.5%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 58.2%
Calm 56.1%
Happy 42.2%
Surprised 0.6%
Confused 0.5%
Disgusted 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 52-60
Gender Male, 58.5%
Happy 72.7%
Calm 23.3%
Confused 1.4%
Disgusted 1.1%
Angry 0.4%
Sad 0.4%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 91.6%
Happy 3.7%
Sad 1.7%
Confused 1%
Surprised 0.9%
Disgusted 0.6%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 31-41
Gender Female, 99.3%
Calm 98.5%
Happy 1.3%
Sad 0.1%
Surprised 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Female, 79.2%
Happy 47.7%
Calm 28.4%
Confused 18.1%
Sad 3.5%
Surprised 1.2%
Angry 0.5%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 49-57
Gender Male, 90.1%
Happy 83.9%
Calm 13.4%
Confused 0.9%
Sad 0.7%
Angry 0.3%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 35-43
Gender Male, 94.8%
Calm 93.3%
Happy 4.8%
Sad 0.6%
Surprised 0.5%
Confused 0.3%
Fear 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 27-37
Gender Male, 69.7%
Calm 83.3%
Sad 8.4%
Surprised 4.6%
Confused 1.5%
Fear 1%
Angry 0.7%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 48-56
Gender Female, 95.8%
Happy 97.5%
Calm 1.9%
Angry 0.1%
Sad 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 98.4%
Calm 77.2%
Sad 21.5%
Confused 0.9%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 51-59
Gender Male, 56.5%
Calm 81.6%
Happy 17.2%
Sad 0.5%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 40-48
Gender Female, 91.4%
Calm 73.4%
Happy 22%
Confused 1.7%
Sad 1.6%
Angry 0.4%
Disgusted 0.4%
Surprised 0.2%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.4%
Person 98.8%
Person 98.4%
Person 98%
Person 95.5%
Person 95.5%
Person 93.8%
Person 90.4%
Person 90.3%
Person 87.4%
Person 85.4%
Person 84.7%
Person 71.6%
Person 59.3%
Person 58.2%
Person 48.4%

Text analysis

Amazon

6.
MJI7--YT37AS--A

Google

16.
16.