Human Generated Data

Title

Untitled (family with four young children posed sitting in living room)
Date

1961
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9757

Human Generated Data

Title

Untitled (family with four young children posed sitting in living room)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9757

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Person 99.5
Human 99.5
Clothing 99.4
Apparel 99.4
Play 98.9
Person 98.9
Person 98.6
Person 96.1
Person 95.9
Person 95.8
Shorts 95
Stage 94.8
Female 94.3
Dress 89.3
Kid 86.8
Child 86.8
Icing 85.5
Food 85.5
Dessert 85.5
Cake 85.5
Cream 85.5
Creme 85.5
Face 85
Chair 82.9
Furniture 82.9
Girl 81.4
People 74.3
Woman 73.4
Indoors 71
Floor 69.6
Leisure Activities 69.1
Person 68.8
Suit 67.7
Coat 67.7
Overcoat 67.7
Portrait 63.8
Photography 63.8
Photo 63.8
Shoe 63.8
Footwear 63.8
Shoe 63.1
Teen 62.7
Table 61.5
Smile 60.8
Blonde 58.6
Door 58.1
Boy 57
Dance Pose 56.9

Clarifai
created on 2023-10-27

people 99.7
group together 99.1
monochrome 97.6
man 97.4
child 97.3
group 96.3
sport 96.2
woman 95.7
competition 94.4
adult 94.3
boy 93.5
athlete 93.2
exercise 92.7
action energy 91.3
education 90.5
girl 89.3
several 87.5
adolescent 87.4
many 87
ball 86.3

Imagga
created on 2022-01-24

sport 35
person 33.2
ball 28.2
man 26.9
people 24
male 23.6
athlete 23.1
planner 23
exercise 20.9
fitness 19
player 17.3
active 17.1
sibling 16.9
black 16.8
adult 16.6
body 16
women 15
fun 15
play 14.6
competition 14.6
lifestyle 14.4
team 14.3
portrait 14.2
fit 13.8
run 13.5
equipment 13.1
men 12.9
sexy 12.8
recreation 12.5
game 12.5
action 11.1
training 11.1
chair 10.1
smiling 10.1
healthy 10.1
power 10.1
playing 10
holding 9.9
child 9.8
attractive 9.8
health 9.7
couple 9.6
love 9.5
knee pad 9.4
model 9.3
dark 9.2
one 9
life 9
boy 8.7
exercising 8.7
workout 8.6
game equipment 8.6
sitting 8.6
smile 8.5
business 8.5
sports equipment 8.5
professional 8.4
leisure 8.3
human 8.2
happy 8.1
activity 8.1
soccer ball 8
looking 8
clothing 7.9
stick 7.9
motion 7.7
basketball 7.7
running 7.7
youth 7.7
legs 7.5
fashion 7.5
protective garment 7.5
outdoors 7.5
sensual 7.3
suit 7.2
guy 7.1
hockey stick 7.1
happiness 7
together 7

Google
created on 2022-01-24

Shorts 90.9
Black 89.5
Black-and-white 86.2
Style 84.1
Font 80
Monochrome 78.7
Monochrome photography 77.4
Event 73.1
Curtain 72.9
Happy 72.4
Performing arts 71.8
Music 70
Art 69.5
Entertainment 67.2
Visual arts 65.1
Room 64
Audio equipment 63.9
Stock photography 63.2
Choreography 62.6
Fun 61.2

Microsoft
created on 2022-01-24

text 99.3
person 95
footwear 94.3
clothing 83.9
posing 40.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 82.6%
Calm 92.2%
Surprised 6.3%
Happy 0.5%
Fear 0.4%
Angry 0.3%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 42-50
Gender Male, 83.9%
Happy 75.6%
Calm 23.8%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%
Sad 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Female, 90.9%
Happy 91.5%
Calm 3.2%
Sad 1.5%
Fear 1.2%
Surprised 1%
Angry 0.9%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 20-28
Gender Female, 85.2%
Surprised 35.6%
Fear 18.5%
Sad 14.7%
Angry 10.7%
Calm 8.3%
Happy 8.2%
Disgusted 2.5%
Confused 1.6%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Happy 76.6%
Calm 16.1%
Sad 3.3%
Surprised 1.1%
Angry 1.1%
Disgusted 0.9%
Confused 0.7%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.5%
Person 98.9%
Person 98.6%
Person 96.1%
Person 95.9%
Person 95.8%
Person 68.8%
Shoe 63.8%
Shoe 63.1%

Categories

Imagga

people portraits 30.3%
paintings art 22.3%
interior objects 16.1%
text visuals 8.1%
events parties 7.7%
pets animals 7.6%
food drinks 6.3%

Text analysis

Google

MJI7-- Y T33A°2--XAGON
MJI7--
Y
T33A°2--XAGON