Human Generated Data

Title

Untitled (man in plus fours, polka dot shirt with floppy bow at neck, and straw hat standing center, groups of people in meadow)

Date

20th century

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 4.2002.22230

Human Generated Data

Title

Untitled (man in plus fours, polka dot shirt with floppy bow at neck, and straw hat standing center, groups of people in meadow)

People

Artist: Unidentified Artist,

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 4.2002.22230

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Clothing 100
Apparel 100
Shorts 100
Person 99.7
Human 99.7
Person 97.2
Person 95
Person 94.3
Person 92.1
Sun Hat 91.3
Hat 91.3
Person 90.2
Person 82.9
Person 82.7
Cowboy Hat 79.7
Person 79.2
Person 78.3
Person 60
Person 58.5
Person 53.2

Clarifai
created on 2023-10-22

people 99.7
lid 96
child 95
group together 94.3
group 94.3
cavalry 93.1
adult 93.1
wear 92.3
two 92.3
man 90.7
woman 87.1
veil 84.4
three 83.8
boy 82.2
canine 81.2
leader 80.2
dog 78.6
one 75.4
several 75.4
recreation 75.1

Imagga
created on 2022-03-11

ballplayer 55.2
player 48.7
athlete 46.2
contestant 34.2
person 29.1
cowboy hat 27.7
people 27.3
man 26.9
hat 26.2
outdoor 22.2
cowboy 22.1
male 22
sunset 18.9
active 18.9
clothing 18
summer 17.4
sky 17.2
headdress 16.8
sport 16.8
boy 16.5
adult 16.3
outdoors 15.7
child 15.4
field 15.1
activity 14.3
silhouette 14.1
outside 13.7
leisure 13.3
sun 12.9
grass 12.7
beach 12.6
recreation 12.6
happy 12.5
lifestyle 11.6
love 11.1
clouds 11
happiness 11
joy 10.9
park 10.7
family 10.7
fun 10.5
walk 10.5
couple 10.5
walking 10.4
exercise 10
mountain 9.8
freedom 9.1
world 9.1
life 8.9
success 8.9
together 8.8
hiking 8.7
sea 8.6
uniform 8.6
men 8.6
dusk 8.6
adventure 8.5
sand 8.5
two 8.5
free 8.4
old 8.4
teenager 8.2
vacation 8.2
sunlight 8
kid 8
day 7.8
hike 7.8
enjoy 7.5
evening 7.5
ocean 7.5
landscape 7.4
holding 7.4
water 7.3
children 7.3
danger 7.3
meadow 7.2
portrait 7.1
travel 7

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

grass 98.8
outdoor 97
text 91.2
clothing 83.2
animal 74.9
person 74.6
dog 66.5
old 66
black 65.7
black and white 65.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 82.2%
Calm 95.6%
Happy 2.1%
Surprised 1%
Disgusted 0.4%
Sad 0.4%
Confused 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 20-28
Gender Male, 94%
Calm 86.1%
Happy 7.3%
Sad 1.6%
Angry 1.4%
Fear 1.1%
Disgusted 1.1%
Confused 1%
Surprised 0.4%

AWS Rekognition

Age 16-22
Gender Male, 73.3%
Calm 74.8%
Sad 14.5%
Confused 2.5%
Surprised 2.4%
Angry 2%
Fear 1.4%
Disgusted 1.2%
Happy 1.2%

AWS Rekognition

Age 10-18
Gender Male, 78.2%
Calm 47.2%
Sad 25.8%
Happy 14.5%
Angry 5.9%
Surprised 2.3%
Disgusted 2%
Fear 1.3%
Confused 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.7%
Person 97.2%
Person 95%
Person 94.3%
Person 92.1%
Person 90.2%
Person 82.9%
Person 82.7%
Person 79.2%
Person 78.3%
Person 60%
Person 58.5%
Person 53.2%

Categories