Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Pittsburgh. "Kingsley House": Kingsley House, Pittsburg, Pa.: In the Gymnasium.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3276.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Pittsburgh. "Kingsley House": Kingsley House, Pittsburg, Pa.: In the Gymnasium.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3276.2

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Person 99.8
Human 99.8
Person 99.7
Person 99.6
Person 99.4
Person 98.9
Person 95.2
Person 94.9
Room 93.1
Indoors 93.1
Person 91
Person 76.2
Classroom 74.1
School 74.1
Person 72.6
Painting 72.4
Art 72.4
Person 68.8
People 67.6
Person 60.4
Interior Design 59.9
Coat 58.2
Clothing 58.2
Apparel 58.2
Kindergarten 57
Person 56.9

Imagga
created on 2022-07-02

hall 33.7
groom 28.5
people 26.2
building 23.7
dress 18.1
man 17.5
city 17.4
room 17.3
window 17.2
business 16.4
women 15.8
bride 15.3
interior 15
architecture 14.8
church 14.8
wedding 14.7
love 14.2
men 13.7
classroom 13.7
old 13.2
male 12.8
adult 12.6
tourism 12.4
businessman 12.4
person 12.2
group 12.1
couple 11.3
culture 11.1
structure 11
two 11
religion 10.7
urban 10.5
scene 10.4
corporate 10.3
inside 10.1
tourist 10
travel 9.9
history 9.8
arch 9.7
professional 9.5
happiness 9.4
happy 9.4
floor 9.3
decoration 8.9
cathedral 8.9
new 8.9
crowd 8.6
life 8.6
day 8.6
married 8.6
art 8.6
glass 8.6
bouquet 8.5
design 8.4
portrait 8.4
chair 8.3
historic 8.2
indoor 8.2
team 8.1
work 8
celebration 8
job 8
column 7.9
wall 7.8
modern 7.7
winter 7.7
marriage 7.6
school 7.5
office 7.5
silhouette 7.4
tradition 7.4
color 7.2
suit 7.2
gate 7.2
holiday 7.2
indoors 7

Google
created on 2022-07-02

Window 92.3
Dress 88.1
Art 83
Tints and shades 77.2
Vintage clothing 75
Hall 73.1
Room 71.3
Event 70.4
Monochrome 68.9
Building 66.9
History 64.9
Visual arts 64.8
Stock photography 64.3
Child 63
Rectangle 54.7
Toddler 54.1
Collection 53.6
Illustration 52.9

Microsoft
created on 2022-07-02

person 97
clothing 96.6
floor 94.7
indoor 94.7
dress 88.3
window 84.6
old 81.5
woman 74
text 65.9
group 62.9
posing 40.2
dressed 29.8
clothes 20.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 7-17
Gender Female, 99.8%
Happy 68.8%
Calm 21.6%
Surprised 7.7%
Fear 6.8%
Sad 2.6%
Confused 2%
Disgusted 0.8%
Angry 0.5%

AWS Rekognition

Age 18-24
Gender Female, 87.2%
Sad 100%
Surprised 6.4%
Confused 6.3%
Fear 6%
Calm 1.9%
Angry 0.7%
Disgusted 0.3%
Happy 0%

AWS Rekognition

Age 16-24
Gender Male, 99.9%
Calm 70.7%
Sad 28.9%
Surprised 7.1%
Fear 6.9%
Confused 2.3%
Angry 1.7%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Female, 99.8%
Calm 93.1%
Surprised 6.5%
Fear 6.1%
Sad 4.2%
Angry 0.6%
Disgusted 0.3%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 82.5%
Sad 12.1%
Fear 6.9%
Surprised 6.6%
Angry 0.9%
Disgusted 0.2%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 9-17
Gender Female, 100%
Sad 87.3%
Calm 45.1%
Surprised 6.9%
Fear 6.5%
Disgusted 5.5%
Angry 3.3%
Confused 2.1%
Happy 1.2%

AWS Rekognition

Age 13-21
Gender Female, 65%
Calm 68.2%
Sad 23.8%
Fear 9.5%
Surprised 6.4%
Happy 1.8%
Confused 1.5%
Disgusted 1.1%
Angry 0.7%

AWS Rekognition

Age 19-27
Gender Male, 95.1%
Calm 58.9%
Sad 23.6%
Confused 17.7%
Surprised 6.5%
Fear 6%
Angry 3.2%
Disgusted 0.4%
Happy 0.4%

AWS Rekognition

Age 24-34
Gender Female, 100%
Calm 83.5%
Angry 10%
Surprised 6.4%
Fear 6%
Sad 3.9%
Disgusted 1.3%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 4-12
Gender Female, 69.4%
Calm 95.3%
Surprised 6.3%
Fear 6%
Sad 3.3%
Disgusted 0.8%
Angry 0.2%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Female, 50.2%
Fear 55.2%
Surprised 37%
Calm 19.6%
Confused 7.1%
Sad 2.9%
Angry 0.6%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 13-21
Gender Male, 93.7%
Happy 55.1%
Sad 26.6%
Calm 12%
Disgusted 7.4%
Surprised 6.8%
Fear 6.4%
Angry 2.3%
Confused 1.1%

AWS Rekognition

Age 18-26
Gender Male, 96.5%
Calm 86.5%
Surprised 6.9%
Fear 6.3%
Angry 6.3%
Sad 2.8%
Confused 1.5%
Disgusted 1.1%
Happy 0.3%

AWS Rekognition

Age 1-7
Gender Female, 100%
Disgusted 39.5%
Calm 37.1%
Fear 8.6%
Surprised 6.6%
Sad 5.8%
Confused 4.7%
Angry 3.3%
Happy 1.5%

AWS Rekognition

Age 20-28
Gender Male, 87.6%
Sad 76.2%
Calm 28.5%
Confused 17.6%
Angry 15.7%
Surprised 6.7%
Fear 6.3%
Happy 0.8%
Disgusted 0.7%

AWS Rekognition

Age 6-16
Gender Female, 98.1%
Calm 89.3%
Surprised 6.6%
Fear 6.5%
Sad 4.3%
Angry 1.6%
Disgusted 0.9%
Happy 0.7%
Confused 0.4%

AWS Rekognition

Age 33-41
Gender Male, 98.6%
Calm 83.7%
Surprised 7.1%
Sad 7%
Fear 6.3%
Confused 2.1%
Angry 1.5%
Disgusted 1.1%
Happy 0.3%

AWS Rekognition

Age 14-22
Gender Male, 99.2%
Sad 100%
Fear 6.4%
Surprised 6.4%
Angry 5.2%
Calm 1.3%
Happy 0.8%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 11-19
Gender Female, 87.6%
Happy 75.5%
Calm 9.7%
Sad 9%
Surprised 6.5%
Fear 6.1%
Confused 1.5%
Disgusted 1%
Angry 0.7%

AWS Rekognition

Age 27-37
Gender Male, 97.7%
Happy 42.8%
Fear 27.2%
Surprised 11.4%
Angry 6%
Disgusted 5.8%
Sad 5%
Calm 3.4%
Confused 1.6%

AWS Rekognition

Age 35-43
Gender Male, 97.1%
Calm 46.2%
Disgusted 27.3%
Happy 15.2%
Surprised 7.3%
Fear 6.3%
Confused 5%
Sad 3%
Angry 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.8%
Painting 72.4%
Coat 58.2%

Categories

Imagga

events parties 47.7%
streetview architecture 34.4%
people portraits 10.9%
interior objects 5.3%

Text analysis

Amazon

12
SEY

Google

SE4 D
SE4
D