Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. Maccabean House: Environment After Immigration. Perpetuation of European Standards in America. Maccabean House, Baltimore, Md.: New Arrivals.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.269.1

Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. Maccabean House: Environment After Immigration. Perpetuation of European Standards in America. Maccabean House, Baltimore, Md.: New Arrivals.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99.7
Human 99.7
Person 99.4
Person 99.3
Person 99.1
Person 99
People 97.5
Family 97
Clothing 94.8
Apparel 94.8
Person 94.3
Yard 87.9
Outdoors 87.9
Nature 87.9
Coat 74.9
Face 69
Portrait 61.2
Photography 61.2
Photo 61.2
Overcoat 59.6
Backyard 58.9
Kid 55.2
Child 55.2

Imagga
created on 2022-06-25

kin 36.5
private 31.9
statue 26
military uniform 24.7
man 24.2
old 22.3
uniform 20.9
sculpture 18.1
people 17.8
male 17.8
clothing 17.3
ancient 15.6
religion 15.2
stone 15.2
culture 14.5
person 14.1
architecture 14
history 13.4
monument 13.1
art 12.4
antique 12.1
city 11.6
vintage 10.9
tourism 10.7
military 10.6
travel 10.6
religious 10.3
helmet 10.3
consumer goods 10.2
covering 10.1
family 9.8
soldier 9.8
adult 9.7
portrait 9.7
black 9.7
war 9.6
historic 9.2
traditional 9.1
catholic 9.1
landmark 9
world 8.5
weapon 8.2
hat 7.8
standing 7.8
army 7.8
men 7.7
god 7.6
historical 7.5
famous 7.4
holding 7.4
tourist 7.3
peace 7.3
figure 7.2
aged 7.2
dirty 7.2
home 7.2
building 7.1
face 7.1
gun 7.1

Google
created on 2022-06-25

Hat 85.7
Headgear 82.1
Jacket 77.4
Vintage clothing 75.8
Sun hat 69
History 67.8
Fence 66.5
Toddler 63.5
Overcoat 62
Uniform 61.9
Monochrome 60.2
Child 58.4
Crew 57.1
Classic 56.9
Home fencing 54
Wood 51.5
Family 51.3

Microsoft
created on 2022-06-25

person 99.6
clothing 99.6
smile 97.4
human face 97.1
outdoor 96.7
old 94.6
toddler 93.4
military uniform 92.7
baby 92.6
standing 92.3
posing 90.9
black 83.9
boy 82
child 73.4
white 69.9
photograph 67.1
woman 65.3
man 58.7
vintage clothing 51.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 97%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Angry 0.9%
Confused 0.8%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 14-22
Gender Female, 61.3%
Sad 100%
Angry 9.9%
Surprised 6.3%
Fear 6%
Calm 3.5%
Confused 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 4-10
Gender Male, 100%
Calm 95.7%
Surprised 6.3%
Fear 6%
Sad 2.9%
Angry 0.8%
Confused 0.4%
Happy 0.3%
Disgusted 0.1%

AWS Rekognition

Age 6-14
Gender Male, 99.6%
Calm 86.7%
Fear 6.3%
Surprised 6.3%
Sad 5.9%
Angry 1.9%
Disgusted 1.3%
Confused 0.7%
Happy 0.6%

AWS Rekognition

Age 37-45
Gender Female, 100%
Calm 76.2%
Confused 10.9%
Surprised 7.5%
Fear 6.2%
Happy 4.3%
Angry 2.9%
Sad 2.6%
Disgusted 1.3%

AWS Rekognition

Age 2-8
Gender Male, 100%
Calm 97.2%
Surprised 6.3%
Fear 5.9%
Sad 2.8%
Confused 0.5%
Angry 0.1%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 97.5%
a vintage photo of a group of people posing for the camera 96.4%
an old photo of a group of people posing for the camera 96.3%

Text analysis

Amazon

S
of
9 of
9

Google

B a
B
a