Human Generated Data

Title

Untitled (children, assignment on Lower East Side)

Date

c. 1900

People

Artist: Jessie Tarbox Beals, American 1870 - 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3158

Human Generated Data

Title

Untitled (children, assignment on Lower East Side)

People

Artist: Jessie Tarbox Beals, American 1870 - 1942

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3158

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.4
Human 98.4
Person 98
Person 97
Person 96.4
Person 94.1
Person 93.3
Person 92.3
Prison 89.6
Person 85
Clothing 84.9
Apparel 84.9
Face 83.4
Head 80.8
Person 80.2
Person 79.6
Person 76
Jaw 71.8
Fence 60.3

Clarifai
created on 2023-10-27

people 99.8
child 99.7
boy 99.1
portrait 98.8
group 98.1
son 98
documentary 97.2
train 96.6
street 96.5
sepia 96
wear 95.3
girl 94.6
locomotive 93.6
vintage 92.2
man 92.1
nostalgia 90.3
school 90.2
lid 89.6
adult 88.8
facial expression 87.9

Imagga
created on 2022-01-23

vintage 29.1
people 21.2
bottle 19
elevator 18.1
person 15.7
man 15.4
kin 15.2
family 15.1
black 15
adult 14.9
vessel 14.6
lifting device 14.5
wine bottle 14.4
happy 13.8
portrait 13.6
male 13.5
device 13.4
smiling 12.3
child 11.9
women 11.8
love 11.8
container 11.4
old 11.1
lifestyle 10.8
mother 10.8
interior 10.6
human 10.5
attractive 10.5
one 10.4
business 10.3
happiness 10.2
punching bag 10.2
outdoors 9.7
shop 9.6
looking 9.6
couple 9.6
sitting 9.4
men 9.4
smile 9.3
city 9.1
hand 9.1
fashion 9
sexy 8.8
wife 8.5
girls 8.2
retro 8.2
urban 7.9
winery 7.8
pretty 7.7
two 7.6
dark 7.5
pop bottle 7.4
clothing 7.4
home 7.2
face 7.1

Google
created on 2022-01-23

Head 97.2
Art 84.3
Headgear 82.3
Event 72.7
Fun 68.1
Team 67.9
Visual arts 67
Monochrome 62.4
Vintage clothing 61.6
Public transport 59.6
Happy 59.3
Room 58.9
Hat 58.9
Child 56.6
Collection 55.4
Illustration 53.5
Monochrome photography 53.4
Transport 52.1
Laugh 51.9
Photographic paper 51.5

Microsoft
created on 2022-01-23

human face 99.6
person 99
smile 97.1
clothing 96.4
child 91.5
boy 86.6
girl 76.3
text 72.4
baby 70.3
toddler 66.3
woman 66.2
group 65.7
old 64.5
posing 63.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Male, 98.8%
Calm 61%
Angry 22.3%
Sad 4.1%
Confused 3.9%
Fear 3.5%
Surprised 2.8%
Happy 1.5%
Disgusted 0.9%

AWS Rekognition

Age 6-16
Gender Female, 96.1%
Calm 98.9%
Angry 0.4%
Sad 0.3%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 42.4%
Disgusted 26.8%
Happy 9.6%
Surprised 8.9%
Angry 5.3%
Confused 3.1%
Sad 2.1%
Fear 1.6%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 97.7%
Happy 1.5%
Angry 0.2%
Sad 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 75.8%
Happy 23%
Angry 0.3%
Surprised 0.3%
Confused 0.2%
Disgusted 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 6-14
Gender Female, 96.3%
Calm 93.1%
Fear 3.1%
Sad 1.6%
Happy 0.6%
Angry 0.6%
Disgusted 0.4%
Confused 0.3%
Surprised 0.2%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 86.8%
Surprised 7%
Sad 3.7%
Fear 0.8%
Angry 0.5%
Confused 0.5%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 9-17
Gender Female, 79.9%
Calm 81.4%
Fear 16.7%
Surprised 1%
Sad 0.4%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.4%
Calm 77.1%
Sad 13.4%
Surprised 4.7%
Happy 2.1%
Angry 0.9%
Fear 0.8%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 10-18
Gender Male, 81%
Calm 44.5%
Angry 24.3%
Sad 21.1%
Confused 3.7%
Surprised 2.2%
Happy 1.8%
Disgusted 1.4%
Fear 1%

AWS Rekognition

Age 6-16
Gender Female, 99.5%
Sad 46.6%
Calm 37.9%
Fear 5.2%
Confused 3.8%
Surprised 3.2%
Angry 1.6%
Happy 0.8%
Disgusted 0.8%

AWS Rekognition

Age 6-14
Gender Female, 90.5%
Sad 90.4%
Calm 4%
Confused 1.9%
Happy 1.1%
Fear 0.8%
Angry 0.7%
Surprised 0.6%
Disgusted 0.5%

AWS Rekognition

Age 12-20
Gender Female, 99.4%
Calm 87.2%
Surprised 4%
Happy 3.4%
Disgusted 1.4%
Confused 1.3%
Angry 1.2%
Sad 0.9%
Fear 0.5%

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%

Categories

Imagga

paintings art 98.5%