Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. "Maccabean House": Environment After Immigration. Perpetuation of European Standards in America. Maccabean House, Baltimore, Md.: Sweat shops near by

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.274.3

Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. "Maccabean House": Environment After Immigration. Perpetuation of European Standards in America. Maccabean House, Baltimore, Md.: Sweat shops near by

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99
Human 99
Restaurant 98.9
Person 98.7
Person 98.6
Person 97.2
Furniture 96.5
Person 96.5
Person 95.4
Person 94.8
Workshop 94.6
Person 92.5
Table 91.3
Chair 88.8
Cafeteria 82.3
Dining Table 81
Meal 79.1
Food 79.1
Building 75.2
Room 74.7
Indoors 74.7
Tie 68.7
Accessory 68.7
Accessories 68.7
Food Court 68.4
Person 68
Cafe 58.8
Housing 58.7
Factory 58.2
Pub 55.3
Person 54.6

Imagga
created on 2022-06-25

barbershop 100
mercantile establishment 100
shop 100
place of business 74.5
establishment 37.2
room 25.7
man 25.5
indoors 23.7
people 23.4
interior 23
chair 20.2
table 19.9
medical 18.5
male 18.4
home 17.5
hospital 15.4
person 14.9
men 14.6
work 14.1
doctor 14.1
life 14.1
modern 14
medicine 13.2
restaurant 13.2
patient 12.8
food 12.7
professional 12.7
health 12.5
smiling 12.3
adult 12.3
occupation 11.9
glass 10.9
house 10.9
family 10.7
business 10.3
women 10.3
inside 10.1
dinner 10.1
kitchen 9.8
old 9.8
working 9.7
dining 9.5
happy 9.4
lifestyle 9.4
floor 9.3
portrait 9.1
equipment 9
laboratory 8.7
nurse 8.7
scene 8.7
party 8.6
sitting 8.6
senior 8.4
mature 8.4
drink 8.3
city 8.3
furniture 8.2
window 8.2
meal 8.1
job 8
decoration 8
operation 7.9
architecture 7.8
clinic 7.8
ancient 7.8
empty 7.7
lunch 7.7
illness 7.6
research 7.6
talking 7.6
elegance 7.6
eat 7.5
place 7.4
holding 7.4
service 7.4
seat 7.3
office 7.2
worker 7.1
smile 7.1
science 7.1
surgeon 7.1
decor 7.1

Google
created on 2022-06-25

Microsoft
created on 2022-06-25

clothing 98.8
furniture 96.2
indoor 95.4
person 93.8
old 93.5
text 92.3
chair 91.3
man 90.1
working 55.7
restaurant 54.8
table 27.8
cooking 20.4
clothes 15.7
dining table 9.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 95.9%
Surprised 6.4%
Fear 6%
Sad 2.3%
Happy 2.1%
Angry 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.5%
Calm 98.7%
Surprised 6.4%
Fear 6%
Sad 2.3%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 18-24
Gender Female, 96.1%
Calm 61.3%
Fear 12.4%
Sad 12%
Surprised 9.4%
Confused 2.8%
Disgusted 2.1%
Angry 2%
Happy 1.6%

AWS Rekognition

Age 7-17
Gender Female, 70.8%
Happy 95.3%
Surprised 7.6%
Fear 6%
Sad 2.2%
Calm 0.8%
Confused 0.5%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 79.6%
Confused 8.9%
Surprised 6.6%
Fear 6%
Sad 5.9%
Angry 2%
Disgusted 0.8%
Happy 0.4%

AWS Rekognition

Age 19-27
Gender Male, 97.8%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Calm 87.9%
Surprised 6.5%
Fear 6.2%
Sad 4.6%
Confused 2.8%
Happy 1.2%
Angry 0.8%
Disgusted 0.4%

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Tie 68.7%

Captions

Microsoft

a vintage photo of a person cooking in a kitchen 61.6%
an old photo of a person cooking in a kitchen 61.5%
a vintage photo of a person cooking in the kitchen 60.6%

Text analysis

Amazon

13
LEE
9 B 13
B
9
LEE SMETER
SMETER

Google

LEE EXCETER
LEE
EXCETER